Query (id=b04615c310d227c4:3270037300000000): Summary: Session ID: 6b4b502e0b1dea2e:58640ad0c9572ca7 Session Type: BEESWAX Start Time: 2018-01-13 07:48:09.911871000 End Time: 2018-01-13 07:58:35.919751000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded: Error occurred on backend vc1517.foo.com:22000 by fragment b04615c310d227c4:32700373000000be Memory left in process limit: 38.07 GB Memory left in query limit: -724.17 KB Query(b04615c310d227c4:3270037300000000): memory limit exceeded. Limit=6.00 GB Reservation=171.88 MB ReservationLimit=4.80 GB OtherMemory=5.83 GB Total=6.00 GB Peak=6.00 GB Unclaimed reservations: Reservation=68.00 MB OtherMemory=0 Total=68.00 MB Peak=177.75 MB Fragment b04615c310d227c4:32700373000000e3: Reservation=0 OtherMemory=148.39 KB Total=148.39 KB Peak=1.57 MB SORT_NODE (id=16): Total=4.00 KB Peak=4.00 KB AGGREGATION_NODE (id=27): Total=76.12 KB Peak=76.12 KB Exprs: Total=76.12 KB Peak=76.12 KB EXCHANGE_NODE (id=26): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=0 KrpcDataStreamSender (dst_id=28): Total=53.19 KB Peak=53.19 KB CodeGen: Total=7.07 KB Peak=1.44 MB Fragment b04615c310d227c4:32700373000000be: Reservation=103.88 MB OtherMemory=5.78 GB Total=5.88 GB Peak=5.88 GB Runtime Filter Bank: Total=2.00 MB Peak=2.00 MB AGGREGATION_NODE (id=15): Total=76.12 KB Peak=76.12 KB Exprs: Total=76.12 KB Peak=76.12 KB HASH_JOIN_NODE (id=14): Reservation=1.94 MB OtherMemory=74.25 KB Total=2.01 MB Peak=2.03 MB Exprs: Total=9.12 KB Peak=9.12 KB Hash Join Builder (join_node_id=14): Total=9.12 KB Peak=17.12 KB Hash Join Builder (join_node_id=14) Exprs: Total=9.12 KB Peak=9.12 KB HASH_JOIN_NODE (id=13): Reservation=1.94 MB OtherMemory=74.25 KB Total=2.01 MB Peak=2.03 MB Exprs: Total=13.12 KB Peak=13.12 KB Hash Join Builder (join_node_id=13): Total=13.12 KB Peak=21.12 KB Hash Join Builder (join_node_id=13) Exprs: Total=13.12 KB Peak=13.12 KB HASH_JOIN_NODE (id=12): Reservation=100.00 MB OtherMemory=52.25 KB Total=100.05 MB Peak=100.13 MB Exprs: Total=22.12 KB Peak=22.12 KB Hash Join Builder (join_node_id=12): Total=22.12 KB Peak=62.12 KB Hash Join Builder (join_node_id=12) Exprs: Total=22.12 KB Peak=22.12 KB EXCHANGE_NODE (id=22): Total=0 Peak=0 KrpcDataStreamRecvr: Total=5.77 GB Peak=5.77 GB EXCHANGE_NODE (id=23): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=35.25 MB EXCHANGE_NODE (id=24): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=28.02 KB EXCHANGE_NODE (id=25): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=108.03 KB KrpcDataStreamSender (dst_id=26): Total=1.92 MB Peak=1.92 MB CodeGen: Total=26.54 KB Peak=4.14 MB Fragment b04615c310d227c4:3270037300000019: Reservation=0 OtherMemory=54.96 MB Total=54.96 MB Peak=66.90 MB Runtime Filter Bank: Total=2.01 MB Peak=2.01 MB HDFS_SCAN_NODE (id=2): Total=12.62 MB Peak=22.11 MB KrpcDataStreamSender (dst_id=22): Total=40.28 MB Peak=42.78 MB CodeGen: Total=1.18 KB Peak=299.50 KB Fragment b04615c310d227c4:3270037300000094: Reservation=0 OtherMemory=0 Total=0 Peak=805.20 MB HASH_JOIN_NODE (id=11): Reservation=0 OtherMemory=0 Total=0 Peak=80.07 MB Hash Join Builder (join_node_id=11): Total=0 Peak=21.12 KB HASH_JOIN_NODE (id=10): Reservation=0 OtherMemory=0 Total=0 Peak=1.99 MB Hash Join Builder (join_node_id=10): Total=0 Peak=17.12 KB HASH_JOIN_NODE (id=9): Reservation=0 OtherMemory=0 Total=0 Peak=576.10 MB Hash Join Builder (join_node_id=9): Total=0 Peak=47.12 KB EXCHANGE_NODE (id=18): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=90.06 MB EXCHANGE_NODE (id=19): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=53.25 MB EXCHANGE_NODE (id=20): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=4.00 KB EXCHANGE_NODE (id=22): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=17.69 MB KrpcDataStreamSender (dst_id=23): Total=0 Peak=67.64 MB CodeGen: Total=0 Peak=3.56 MB Fragment b04615c310d227c4:327003730000003b: Reservation=0 OtherMemory=0 Total=0 Peak=48.23 MB HDFS_SCAN_NODE (id=1): Total=0 Peak=6.22 MB KrpcDataStreamSender (dst_id=18): Total=0 Peak=41.96 MB CodeGen: Total=0 Peak=367.50 KB Fragment b04615c310d227c4:3270037300000062: Reservation=0 OtherMemory=0 Total=0 Peak=55.67 MB HASH_JOIN_NODE (id=8): Reservation=0 OtherMemory=0 Total=0 Peak=2.03 MB Hash Join Builder (join_node_id=8): Total=0 Peak=17.12 KB HDFS_SCAN_NODE (id=0): Total=0 Peak=10.35 MB EXCHANGE_NODE (id=17): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=4.00 KB KrpcDataStreamSender (dst_id=19): Total=0 Peak=43.29 MB CodeGen: Total=0 Peak=1.46 MB Fragment b04615c310d227c4:327003730000007b: Reservation=0 OtherMemory=0 Total=0 Peak=11.17 MB HDFS_SCAN_NODE (id=7): Total=0 Peak=7.51 MB KrpcDataStreamSender (dst_id=21): Total=0 Peak=3.61 MB CodeGen: Total=0 Peak=52.50 KB Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (build c841ad9d6c021408af0ba34bb31134e9a6a3239d) User: impala/va1026.foo.com@foo.COM Connected User: impala/va1026.foo.com@foo.COM Delegated User: Network Address: 172.28.193.207:34364 Default Db: tpcds_10000_parquet_1_rack Sql Statement: select i_item_id ,i_item_desc ,s_store_id ,s_store_name ,max(ss_quantity) as store_sales_quantity ,max(sr_return_quantity) as store_returns_quantity ,max(cs_quantity) as catalog_sales_quantity from store_sales ,store_returns ,catalog_sales ,date_dim d1 ,date_dim d2 ,date_dim d3 ,store ,item where d1.d_moy = 4 and d1.d_year = 2000 and d1.d_date_sk = ss_sold_date_sk and i_item_sk = ss_item_sk and s_store_sk = ss_store_sk and ss_customer_sk = sr_customer_sk and ss_item_sk = sr_item_sk and ss_ticket_number = sr_ticket_number and sr_returned_date_sk = d2.d_date_sk and d2.d_moy between 4 and 4 + 3 and d2.d_year = 2000 and sr_customer_sk = cs_bill_customer_sk and sr_item_sk = cs_item_sk and cs_sold_date_sk = d3.d_date_sk and d3.d_year in (2000,2000+1,2000+2) group by i_item_id ,i_item_desc ,s_store_id ,s_store_name order by i_item_id ,i_item_desc ,s_store_id ,s_store_name limit 100 Coordinator: va1026.foo.com:22000 Query Options (set by configuration): MEM_LIMIT=6442450944,MAX_NUM_RUNTIME_FILTERS=50,RUNTIME_FILTER_MIN_SIZE=8192,RUNTIME_FILTER_MAX_SIZE=1048576 Query Options (set by configuration and planner): MEM_LIMIT=6442450944,MAX_NUM_RUNTIME_FILTERS=50,MT_DOP=0,RUNTIME_FILTER_MIN_SIZE=8192,RUNTIME_FILTER_MAX_SIZE=1048576 Plan: ---------------- Max Per-Host Resource Reservation: Memory=177.75MB Per-Host Resource Estimates: Memory=21.81GB F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 28:MERGING-EXCHANGE [UNPARTITIONED] | order by: i_item_id ASC, i_item_desc ASC, s_store_id ASC, s_store_name ASC | limit: 100 | mem-estimate=0B mem-reservation=0B | tuple-ids=9 row-size=212B cardinality=100 | F10:PLAN FRAGMENT [HASH(i_item_id,i_item_desc,s_store_id,s_store_name)] hosts=38 instances=38 Per-Host Resources: mem-estimate=9.33GB mem-reservation=34.00MB 16:TOP-N [LIMIT=100] | order by: i_item_id ASC, i_item_desc ASC, s_store_id ASC, s_store_name ASC | mem-estimate=20.72KB mem-reservation=0B | tuple-ids=9 row-size=212B cardinality=100 | 27:AGGREGATE [FINALIZE] | output: max:merge(ss_quantity), max:merge(sr_return_quantity), max:merge(cs_quantity) | group by: i_item_id, i_item_desc, s_store_id, s_store_name | mem-estimate=9.33GB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=8 row-size=212B cardinality=42921809 | 26:EXCHANGE [HASH(i_item_id,i_item_desc,s_store_id,s_store_name)] | mem-estimate=0B mem-reservation=0B | tuple-ids=8 row-size=212B cardinality=42921809 | F07:PLAN FRAGMENT [HASH(cs_bill_customer_sk,cs_item_sk)] hosts=38 instances=38 Per-Host Resources: mem-estimate=9.79GB mem-reservation=71.88MB 15:AGGREGATE [STREAMING] | output: max(ss_quantity), max(sr_return_quantity), max(cs_quantity) | group by: i_item_id, i_item_desc, s_store_id, s_store_name | mem-estimate=9.33GB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=8 row-size=212B cardinality=42921809 | 14:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | fk/pk conjuncts: ss_store_sk = s_store_sk | runtime filters: RF000[bloom] <- s_store_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB | tuple-ids=2,1,0,3,4,7,5,6 row-size=328B cardinality=42921809 | |--25:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=6 row-size=56B cardinality=1500 | | | F09:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B | 06:SCAN HDFS [tpcds_10000_parquet_1_rack.store, RANDOM] | partitions=1/1 files=1 size=132.82KB | stored statistics: | table: rows=1500 size=132.82KB | columns: all | extrapolated-rows=disabled | mem-estimate=48.00MB mem-reservation=0B | tuple-ids=6 row-size=56B cardinality=1500 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: cs_sold_date_sk = d3.d_date_sk | fk/pk conjuncts: cs_sold_date_sk = d3.d_date_sk | runtime filters: RF002[bloom] <- d3.d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB | tuple-ids=2,1,0,3,4,7,5 row-size=272B cardinality=42921809 | |--24:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=5 row-size=8B cardinality=1118 | | | F08:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=0B | 05:SCAN HDFS [tpcds_10000_parquet_1_rack.date_dim d3, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: d3.d_year IN (2000, 2001, 2002) | stored statistics: | table: rows=73049 size=2.15MB | columns: all | extrapolated-rows=disabled | parquet statistics predicates: d3.d_year IN (2000, 2001, 2002) | parquet dictionary predicates: d3.d_year IN (2000, 2001, 2002) | mem-estimate=32.00MB mem-reservation=0B | tuple-ids=5 row-size=8B cardinality=1118 | 12:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: cs_bill_customer_sk = sr_customer_sk, cs_item_sk = sr_item_sk | fk/pk conjuncts: cs_bill_customer_sk = sr_customer_sk, cs_item_sk = sr_item_sk | runtime filters: RF004[bloom] <- sr_customer_sk, RF005[bloom] <- sr_item_sk | mem-estimate=467.78MB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=2,1,0,3,4,7 row-size=264B cardinality=70525369 | |--23:EXCHANGE [HASH(sr_customer_sk,sr_item_sk)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1,0,3,4,7 row-size=240B cardinality=70525369 | | | F04:PLAN FRAGMENT [HASH(sr_customer_sk,sr_item_sk,sr_ticket_number)] hosts=38 instances=38 | Per-Host Resources: mem-estimate=2.09GB mem-reservation=69.94MB | 11:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_item_sk = i_item_sk | | fk/pk conjuncts: ss_item_sk = i_item_sk | | runtime filters: RF008[bloom] <- i_item_sk | | mem-estimate=65.90MB mem-reservation=34.00MB spill-buffer=2.00MB | | tuple-ids=1,0,3,4,7 row-size=240B cardinality=70525369 | | | |--21:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=7 row-size=156B cardinality=402000 | | | | | F06:PLAN FRAGMENT [RANDOM] hosts=13 instances=13 | | Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B | | 07:SCAN HDFS [tpcds_10000_parquet_1_rack.item, RANDOM] | | partitions=1/1 files=13 size=48.99MB | | stored statistics: | | table: rows=402000 size=48.99MB | | columns: all | | extrapolated-rows=disabled | | mem-estimate=48.00MB mem-reservation=0B | | tuple-ids=7 row-size=156B cardinality=402000 | | | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: sr_returned_date_sk = d2.d_date_sk | | fk/pk conjuncts: sr_returned_date_sk = d2.d_date_sk | | runtime filters: RF010[bloom] <- d2.d_date_sk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB | | tuple-ids=1,0,3,4 row-size=84B cardinality=70935714 | | | |--20:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=4 row-size=12B cardinality=118 | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B | | 04:SCAN HDFS [tpcds_10000_parquet_1_rack.date_dim d2, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d2.d_year = 2000, d2.d_moy <= 7, d2.d_moy >= 4 | | stored statistics: | | table: rows=73049 size=2.15MB | | columns: all | | extrapolated-rows=disabled | | parquet statistics predicates: d2.d_year = 2000, d2.d_moy <= 7, d2.d_moy >= 4 | | parquet dictionary predicates: d2.d_year = 2000, d2.d_moy <= 7, d2.d_moy >= 4 | | mem-estimate=48.00MB mem-reservation=0B | | tuple-ids=4 row-size=12B cardinality=118 | | | 09:HASH JOIN [INNER JOIN, PARTITIONED] | | hash predicates: sr_customer_sk = ss_customer_sk, sr_item_sk = ss_item_sk, sr_ticket_number = ss_ticket_number | | fk/pk conjuncts: sr_customer_sk = ss_customer_sk, sr_item_sk = ss_item_sk, sr_ticket_number = ss_ticket_number | | runtime filters: RF012[bloom] <- ss_customer_sk, RF013[bloom] <- ss_item_sk, RF014[bloom] <- ss_ticket_number | | mem-estimate=2.02GB mem-reservation=34.00MB spill-buffer=2.00MB | | tuple-ids=1,0,3 row-size=72B cardinality=1204704830 | | | |--19:EXCHANGE [HASH(ss_customer_sk,ss_item_sk,ss_ticket_number)] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=0,3 row-size=44B cardinality=1705288398 | | | | | F02:PLAN FRAGMENT [RANDOM] hosts=38 instances=38 | | Per-Host Resources: mem-estimate=161.94MB mem-reservation=1.94MB | | 08:HASH JOIN [INNER JOIN, BROADCAST] | | | hash predicates: ss_sold_date_sk = d1.d_date_sk | | | fk/pk conjuncts: ss_sold_date_sk = d1.d_date_sk | | | runtime filters: RF018[bloom] <- d1.d_date_sk | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB | | | tuple-ids=0,3 row-size=44B cardinality=1705288398 | | | | | |--17:EXCHANGE [BROADCAST] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=3 row-size=12B cardinality=108 | | | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | | | Per-Host Resources: mem-estimate=48.00MB mem-reservation=0B | | | 03:SCAN HDFS [tpcds_10000_parquet_1_rack.date_dim d1, RANDOM] | | | partitions=1/1 files=1 size=2.15MB | | | predicates: d1.d_year = 2000, d1.d_moy = 4 | | | stored statistics: | | | table: rows=73049 size=2.15MB | | | columns: all | | | extrapolated-rows=disabled | | | parquet statistics predicates: d1.d_year = 2000, d1.d_moy = 4 | | | parquet dictionary predicates: d1.d_year = 2000, d1.d_moy = 4 | | | mem-estimate=48.00MB mem-reservation=0B | | | tuple-ids=3 row-size=12B cardinality=108 | | | | | 00:SCAN HDFS [tpcds_10000_parquet_1_rack.store_sales, RANDOM] | | partitions=1824/1824 files=69403 size=1.43TB | | runtime filters: RF000[bloom] -> ss_store_sk, RF008[bloom] -> ss_item_sk, RF018[bloom] -> ss_sold_date_sk | | stored statistics: | | table: rows=28800426268 size=1.43TB | | partitions: 1824/1824 rows=28800426268 | | columns: all | | extrapolated-rows=disabled | | mem-estimate=160.00MB mem-reservation=0B | | tuple-ids=0 row-size=32B cardinality=28800426268 | | | 18:EXCHANGE [HASH(sr_customer_sk,sr_item_sk,sr_ticket_number)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=28B cardinality=2879513368 | | | F01:PLAN FRAGMENT [RANDOM] hosts=38 instances=38 | Per-Host Resources: mem-estimate=64.00MB mem-reservation=0B | 01:SCAN HDFS [tpcds_10000_parquet_1_rack.store_returns, RANDOM] | partitions=2004/2004 files=76031 size=195.30GB | runtime filters: RF008[bloom] -> tpcds_10000_parquet_1_rack.store_returns.sr_item_sk, RF010[bloom] -> sr_returned_date_sk, RF012[bloom] -> sr_customer_sk, RF013[bloom] -> sr_item_sk, RF014[bloom] -> sr_ticket_number | stored statistics: | table: rows=2879513368 size=195.30GB | partitions: 2004/2004 rows=2879513368 | columns: all | extrapolated-rows=disabled | mem-estimate=64.00MB mem-reservation=0B | tuple-ids=1 row-size=28B cardinality=2879513368 | 22:EXCHANGE [HASH(cs_bill_customer_sk,cs_item_sk)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=24B cardinality=14399964710 | F00:PLAN FRAGMENT [RANDOM] hosts=38 instances=38 Per-Host Resources: mem-estimate=168.00MB mem-reservation=0B 02:SCAN HDFS [tpcds_10000_parquet_1_rack.catalog_sales, RANDOM] partitions=1837/1837 files=24804 size=1.01TB runtime filters: RF002[bloom] -> cs_sold_date_sk, RF004[bloom] -> cs_bill_customer_sk, RF005[bloom] -> cs_item_sk stored statistics: table: rows=14399964710 size=1.01TB partitions: 1837/1837 rows=14399964710 columns: all extrapolated-rows=disabled mem-estimate=168.00MB mem-reservation=0B tuple-ids=2 row-size=24B cardinality=14399964710 ---------------- Estimated Per-Host Mem: 23422189343 Per Host Min Reservation: va1026.foo.com:22000(0) vc1501.foo.com:22000(177.75 MB) vc1502.foo.com:22000(177.75 MB) vc1503.foo.com:22000(177.75 MB) vc1504.foo.com:22000(177.75 MB) vc1505.foo.com:22000(177.75 MB) vc1507.foo.com:22000(177.75 MB) vc1508.foo.com:22000(177.75 MB) vc1509.foo.com:22000(177.75 MB) vc1510.foo.com:22000(177.75 MB) vc1511.foo.com:22000(177.75 MB) vc1513.foo.com:22000(177.75 MB) vc1515.foo.com:22000(177.75 MB) vc1516.foo.com:22000(177.75 MB) vc1517.foo.com:22000(177.75 MB) vc1518.foo.com:22000(177.75 MB) vc1519.foo.com:22000(177.75 MB) vc1520.foo.com:22000(177.75 MB) vc1522.foo.com:22000(177.75 MB) vc1523.foo.com:22000(177.75 MB) vc1524.foo.com:22000(177.75 MB) vc1525.foo.com:22000(177.75 MB) vc1526.foo.com:22000(177.75 MB) vc1527.foo.com:22000(177.75 MB) vc1528.foo.com:22000(177.75 MB) vc1529.foo.com:22000(177.75 MB) vc1531.foo.com:22000(177.75 MB) vc1532.foo.com:22000(177.75 MB) vc1533.foo.com:22000(177.75 MB) vc1534.foo.com:22000(177.75 MB) vc1535.foo.com:22000(177.75 MB) vc1536.foo.com:22000(177.75 MB) vc1537.foo.com:22000(177.75 MB) vc1538.foo.com:22000(177.75 MB) vc1539.foo.com:22000(177.75 MB) vc1540.foo.com:22000(177.75 MB) vc1541.foo.com:22000(177.75 MB) vc1542.foo.com:22000(177.75 MB) Request Pool: root.default Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------------------------------- 28:MERGING-EXCHANGE 1 0.000ns 0.000ns 0 100 0 0 UNPARTITIONED 16:TOP-N 37 34.139us 49.928us 0 100 4.00 KB 20.72 KB 27:AGGREGATE 37 12.541ms 104.100ms 0 42.92M 76.12 KB 9.33 GB FINALIZE 26:EXCHANGE 37 0.000ns 0.000ns 0 42.92M 0 0 HASH(i_item_id,i_item_desc,s_store_id,s_store_name) 15:AGGREGATE 37 2.728ms 91.568ms 0 42.92M 76.12 KB 9.33 GB STREAMING 14:HASH JOIN 37 3.255ms 75.023ms 0 42.92M 2.03 MB 1.94 MB INNER JOIN, BROADCAST |--25:EXCHANGE 37 66.054us 93.020us 1.50K 1.50K 0 0 BROADCAST | 06:SCAN HDFS 1 19.992ms 19.992ms 1.50K 1.50K 349.98 KB 48.00 MB tpcds_10000_parquet_1_rack.store 13:HASH JOIN 37 5.681ms 141.448ms 0 42.92M 2.03 MB 1.94 MB INNER JOIN, BROADCAST |--24:EXCHANGE 37 47.316us 76.244us 1.10K 1.12K 0 0 BROADCAST | 05:SCAN HDFS 1 25.697ms 25.697ms 1.10K 1.12K 744.27 KB 32.00 MB tpcds_10000_parquet_1_rack.date_dim d3 12:HASH JOIN 37 1s123ms 21s802ms 0 70.53M 108.13 MB 467.78 MB INNER JOIN, PARTITIONED |--23:EXCHANGE 37 60.893ms 194.422ms 11.15M 70.53M 0 0 HASH(sr_customer_sk,sr_item_sk) | 11:HASH JOIN 37 1s202ms 1s969ms 11.15M 70.53M 80.07 MB 65.90 MB INNER JOIN, BROADCAST | |--21:EXCHANGE 37 62.813ms 801.796ms 402.00K 402.00K 0 0 BROADCAST | | 07:SCAN HDFS 13 211.661ms 577.861ms 402.00K 402.00K 14.83 MB 48.00 MB tpcds_10000_parquet_1_rack.item | 10:HASH JOIN 37 130.099ms 372.693ms 11.15M 70.94M 1.99 MB 1.94 MB INNER JOIN, BROADCAST | |--20:EXCHANGE 37 16.704us 31.121us 122 118 0 0 BROADCAST | | 04:SCAN HDFS 1 57.044ms 57.044ms 122 118 808.28 KB 48.00 MB tpcds_10000_parquet_1_rack.date_dim d2 | 09:HASH JOIN 37 7s109ms 7s982ms 11.33M 1.20B 576.10 MB 2.02 GB INNER JOIN, PARTITIONED | |--19:EXCHANGE 37 318.715ms 629.917ms 260.03M 1.71B 0 0 HASH(ss_customer_sk,ss_item_sk,ss_ticket_number) | | 08:HASH JOIN 37 496.198ms 735.656ms 260.03M 1.71B 2.03 MB 1.94 MB INNER JOIN, BROADCAST | | |--17:EXCHANGE 37 15.748us 36.389us 30 108 0 0 BROADCAST | | | 03:SCAN HDFS 1 58.974ms 58.974ms 30 108 808.28 KB 48.00 MB tpcds_10000_parquet_1_rack.date_dim d1 | | 00:SCAN HDFS 37 1s440ms 12s142ms 260.03M 28.80B 12.87 MB 160.00 MB tpcds_10000_parquet_1_rack.store_sales | 18:EXCHANGE 37 468.946ms 1s080ms 211.94M 2.88B 0 0 HASH(sr_customer_sk,sr_item_sk,sr_ticket_number) | 01:SCAN HDFS 37 5s688ms 11s084ms 211.94M 2.88B 46.75 MB 64.00 MB tpcds_10000_parquet_1_rack.store_returns 22:EXCHANGE 37 7s656ms 10s110ms 4.46B 14.40B 0 0 HASH(cs_bill_customer_sk,cs_item_sk) 02:SCAN HDFS 37 13s752ms 20s057ms 4.46B 14.40B 34.68 MB 168.00 MB tpcds_10000_parquet_1_rack.catalog_sales Errors: Memory limit exceeded: Error occurred on backend vc1517.foo.com:22000 by fragment b04615c310d227c4:32700373000000be Memory left in process limit: 38.07 GB Memory left in query limit: -724.17 KB Query(b04615c310d227c4:3270037300000000): memory limit exceeded. Limit=6.00 GB Reservation=171.88 MB ReservationLimit=4.80 GB OtherMemory=5.83 GB Total=6.00 GB Peak=6.00 GB Unclaimed reservations: Reservation=68.00 MB OtherMemory=0 Total=68.00 MB Peak=177.75 MB Fragment b04615c310d227c4:32700373000000e3: Reservation=0 OtherMemory=148.39 KB Total=148.39 KB Peak=1.57 MB SORT_NODE (id=16): Total=4.00 KB Peak=4.00 KB AGGREGATION_NODE (id=27): Total=76.12 KB Peak=76.12 KB Exprs: Total=76.12 KB Peak=76.12 KB EXCHANGE_NODE (id=26): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=0 KrpcDataStreamSender (dst_id=28): Total=53.19 KB Peak=53.19 KB CodeGen: Total=7.07 KB Peak=1.44 MB Fragment b04615c310d227c4:32700373000000be: Reservation=103.88 MB OtherMemory=5.78 GB Total=5.88 GB Peak=5.88 GB Runtime Filter Bank: Total=2.00 MB Peak=2.00 MB AGGREGATION_NODE (id=15): Total=76.12 KB Peak=76.12 KB Exprs: Total=76.12 KB Peak=76.12 KB HASH_JOIN_NODE (id=14): Reservation=1.94 MB OtherMemory=74.25 KB Total=2.01 MB Peak=2.03 MB Exprs: Total=9.12 KB Peak=9.12 KB Hash Join Builder (join_node_id=14): Total=9.12 KB Peak=17.12 KB Hash Join Builder (join_node_id=14) Exprs: Total=9.12 KB Peak=9.12 KB HASH_JOIN_NODE (id=13): Reservation=1.94 MB OtherMemory=74.25 KB Total=2.01 MB Peak=2.03 MB Exprs: Total=13.12 KB Peak=13.12 KB Hash Join Builder (join_node_id=13): Total=13.12 KB Peak=21.12 KB Hash Join Builder (join_node_id=13) Exprs: Total=13.12 KB Peak=13.12 KB HASH_JOIN_NODE (id=12): Reservation=100.00 MB OtherMemory=52.25 KB Total=100.05 MB Peak=100.13 MB Exprs: Total=22.12 KB Peak=22.12 KB Hash Join Builder (join_node_id=12): Total=22.12 KB Peak=62.12 KB Hash Join Builder (join_node_id=12) Exprs: Total=22.12 KB Peak=22.12 KB EXCHANGE_NODE (id=22): Total=0 Peak=0 KrpcDataStreamRecvr: Total=5.77 GB Peak=5.77 GB EXCHANGE_NODE (id=23): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=35.25 MB EXCHANGE_NODE (id=24): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=28.02 KB EXCHANGE_NODE (id=25): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=108.03 KB KrpcDataStreamSender (dst_id=26): Total=1.92 MB Peak=1.92 MB CodeGen: Total=26.54 KB Peak=4.14 MB Fragment b04615c310d227c4:3270037300000019: Reservation=0 OtherMemory=54.96 MB Total=54.96 MB Peak=66.90 MB Runtime Filter Bank: Total=2.01 MB Peak=2.01 MB HDFS_SCAN_NODE (id=2): Total=12.62 MB Peak=22.11 MB KrpcDataStreamSender (dst_id=22): Total=40.28 MB Peak=42.78 MB CodeGen: Total=1.18 KB Peak=299.50 KB Fragment b04615c310d227c4:3270037300000094: Reservation=0 OtherMemory=0 Total=0 Peak=805.20 MB HASH_JOIN_NODE (id=11): Reservation=0 OtherMemory=0 Total=0 Peak=80.07 MB Hash Join Builder (join_node_id=11): Total=0 Peak=21.12 KB HASH_JOIN_NODE (id=10): Reservation=0 OtherMemory=0 Total=0 Peak=1.99 MB Hash Join Builder (join_node_id=10): Total=0 Peak=17.12 KB HASH_JOIN_NODE (id=9): Reservation=0 OtherMemory=0 Total=0 Peak=576.10 MB Hash Join Builder (join_node_id=9): Total=0 Peak=47.12 KB EXCHANGE_NODE (id=18): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=90.06 MB EXCHANGE_NODE (id=19): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=53.25 MB EXCHANGE_NODE (id=20): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=4.00 KB EXCHANGE_NODE (id=21): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=17.69 MB KrpcDataStreamSender (dst_id=23): Total=0 Peak=67.64 MB CodeGen: Total=0 Peak=3.56 MB Fragment b04615c310d227c4:327003730000003b: Reservation=0 OtherMemory=0 Total=0 Peak=48.23 MB HDFS_SCAN_NODE (id=1): Total=0 Peak=6.22 MB KrpcDataStreamSender (dst_id=18): Total=0 Peak=41.96 MB CodeGen: Total=0 Peak=367.50 KB Fragment b04615c310d227c4:3270037300000062: Reservation=0 OtherMemory=0 Total=0 Peak=55.67 MB HASH_JOIN_NODE (id=8): Reservation=0 OtherMemory=0 Total=0 Peak=2.03 MB Hash Join Builder (join_node_id=8): Total=0 Peak=17.12 KB HDFS_SCAN_NODE (id=0): Total=0 Peak=10.35 MB EXCHANGE_NODE (id=17): Total=0 Peak=0 KrpcDataStreamRecvr: Total=0 Peak=4.00 KB KrpcDataStreamSender (dst_id=19): Total=0 Peak=43.29 MB CodeGen: Total=0 Peak=1.46 MB Fragment b04615c310d227c4:327003730000007b: Reservation=0 OtherMemory=0 Total=0 Peak=11.17 MB HDFS_SCAN_NODE (id=7): Total=0 Peak=7.51 MB KrpcDataStreamSender (dst_id=21): Total=0 Peak=3.61 MB CodeGen: Total=0 Peak=52.50 KB (1 of 9 similar) Planner Timeline: 300.428ms - Analysis finished: 3.026ms (3.026ms) - Value transfer graph computed: 3.074ms (47.273us) - Single node plan created: 285.176ms (282.102ms) - Runtime filters computed: 285.533ms (357.184us) - Distributed plan created: 285.564ms (30.922us) - Lineage info computed: 285.677ms (113.001us) - Planning finished: 300.428ms (14.751ms) Query Timeline: 10m26s - Query submitted: 83.006us (83.006us) - Planning finished: 871.421ms (871.338ms) - Submit for admission: 1s422ms (551.289ms) - Completed admission: 1s422ms (42.100us) - Ready to start on 38 backends: 1s503ms (80.382ms) - All 38 execution backends (240 fragment instances) started: 2s400ms (897.020ms) - First dynamic filter received: 6s135ms (3s735ms) - Rows available: 10m25s (10m19s) - Unregister query: 10m26s (854.373ms) - ComputeScanRangeAssignmentTimer: 305.631ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile b04615c310d227c4:3270037300000000:(Total: 10m23s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 10 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------- 18 8 0 LOCAL true 0 (37) N/A N/A true 14 9 1 REMOTE false 37 (37) N/A N/A true 13 9 1 REMOTE false 37 (37) N/A N/A true 12 9 1 REMOTE false 37 (37) N/A N/A true 10 10 1 REMOTE true 1 (3) N/A N/A true 8 11 1, 0 REMOTE, REMOTE false, false 1 (3) N/A N/A true 5 12 2 REMOTE false 37 (37) N/A N/A true 4 12 2 REMOTE false 37 (37) N/A N/A true 2 13 2 REMOTE true 1 (3) N/A N/A true 0 14 0 REMOTE false 1 (3) N/A N/A true Backend startup latencies: Count: 38, min / max: 103ms / 691ms, 25th %-ile: 146ms, 50th %-ile: 202ms, 75th %-ile: 393ms, 90th %-ile: 440ms, 95th %-ile: 599ms, 99.9th %-ile: 691ms Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------- 18 8 0 LOCAL true 0 (37) N/A N/A true 14 9 1 REMOTE false 0 (37) 3m3s 3m3s false 13 9 1 REMOTE false 0 (37) 3m3s 3m3s false 12 9 1 REMOTE false 0 (37) 3m3s 3m3s false 10 10 1 REMOTE true 0 (3) 1m3s 1m3s false 8 11 1, 0 REMOTE, REMOTE false, false 0 (3) 1m3s 1m3s false 5 12 2 REMOTE false 0 (37) 4m25s 4m36s false 4 12 2 REMOTE false 0 (37) 4m25s 4m36s false 2 13 2 REMOTE true 0 (3) 7s078ms 7s078ms false 0 14 0 REMOTE false 0 (3) 6s135ms 6s135ms false Per Node Peak Memory Usage: va1026.foo.com:22000(2.01 MB) vc1501.foo.com:22000(5.95 GB) vc1502.foo.com:22000(5.86 GB) vc1503.foo.com:22000(5.99 GB) vc1504.foo.com:22000(5.79 GB) vc1505.foo.com:22000(5.89 GB) vc1507.foo.com:22000(5.95 GB) vc1508.foo.com:22000(5.99 GB) vc1509.foo.com:22000(5.71 GB) vc1510.foo.com:22000(5.85 GB) vc1511.foo.com:22000(5.96 GB) vc1513.foo.com:22000(5.93 GB) vc1515.foo.com:22000(5.94 GB) vc1516.foo.com:22000(5.80 GB) vc1517.foo.com:22000(6.00 GB) vc1518.foo.com:22000(5.89 GB) vc1519.foo.com:22000(5.86 GB) vc1520.foo.com:22000(5.79 GB) vc1522.foo.com:22000(5.96 GB) vc1523.foo.com:22000(5.98 GB) vc1524.foo.com:22000(5.94 GB) vc1525.foo.com:22000(5.98 GB) vc1526.foo.com:22000(5.69 GB) vc1527.foo.com:22000(5.96 GB) vc1528.foo.com:22000(5.95 GB) vc1529.foo.com:22000(5.84 GB) vc1531.foo.com:22000(5.88 GB) vc1532.foo.com:22000(5.94 GB) vc1533.foo.com:22000(5.89 GB) vc1534.foo.com:22000(5.84 GB) vc1535.foo.com:22000(5.95 GB) vc1536.foo.com:22000(5.91 GB) vc1537.foo.com:22000(5.85 GB) vc1538.foo.com:22000(6.00 GB) vc1539.foo.com:22000(5.79 GB) vc1540.foo.com:22000(5.93 GB) vc1541.foo.com:22000(6.00 GB) vc1542.foo.com:22000(6.00 GB) - FiltersReceived: 81 (81) - FinalizationTimer: 0.000ns - NumBackends: 38 (38) - NumFragmentInstances: 240 (240) - NumFragments: 12 (12) Averaged Fragment F11:(Total: 24.312ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:10m23s max:10m23s mean: 10m23s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 345.00 KB (353280) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 MB (2105896) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.252ms - ExecTreePrepareTime: 207.516us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 59.945ms, non-child: 59.945ms, % non-child: 100.00%) - CodegenTime: 1.019ms - CompileTime: 7.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 32 (32) - NumInstructions: 674 (674) - OptimizationTime: 30.481ms - PeakMemoryUsage: 337.00 KB (345088) - PrepareTime: 21.550ms EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Coordinator Fragment F11: Instance b04615c310d227c4:3270037300000000 (host=va1026.foo.com:22000):(Total: 24.312ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB, 8.54 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 345.00 KB (353280) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.01 MB (2105896) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.252ms - ExecTreePrepareTime: 207.516us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 59.945ms, non-child: 59.945ms, % non-child: 100.00%) - CodegenTime: 1.019ms - CompileTime: 7.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 32 (32) - NumInstructions: 674 (674) - OptimizationTime: 30.481ms - PeakMemoryUsage: 337.00 KB (345088) - PrepareTime: 21.550ms EXCHANGE_NODE (id=28): ExecOption: Codegen Enabled - ConvertRowBatchTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Averaged Fragment F10:(Total: 691.288ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:10m22s max:10m23s mean: 10m23s stddev:164.473ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 37 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.78 GB (6210143217) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 691.218ms - ExecTreePrepareTime: 12.576ms KrpcDataStreamSender (dst_id=28):(Total: 12.280ms, non-child: 12.280ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s361ms, non-child: 1s361ms, % non-child: 100.00%) - CodegenTime: 53.811ms - CompileTime: 200.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 510.516ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 601.400ms SORT_NODE (id=16):(Total: 12.575ms, non-child: 34.140us, % non-child: 0.27%) - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 12.541ms, non-child: 12.541ms, % non-child: 100.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Fragment F10: Instance b04615c310d227c4:32700373000000eb (host=vc1509.foo.com:22000):(Total: 4s606ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 233.83 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.68 GB (6094848026) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 4s606ms - ExecTreePrepareTime: 23.681ms KrpcDataStreamSender (dst_id=28):(Total: 52.584ms, non-child: 52.584ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 5s875ms, non-child: 5s875ms, % non-child: 100.00%) - CodegenTime: 308.060ms - CompileTime: 390.071ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 1s116ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 3s997ms SORT_NODE (id=16):(Total: 23.680ms, non-child: 46.270us, % non-child: 0.20%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 23.634ms, non-child: 23.634ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d6 (host=vc1542.foo.com:22000):(Total: 3s288ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 189.69 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6389355252) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 3s288ms - ExecTreePrepareTime: 24.486ms KrpcDataStreamSender (dst_id=28):(Total: 33.748ms, non-child: 33.748ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 4s539ms, non-child: 4s539ms, % non-child: 100.00%) - CodegenTime: 154.135ms - CompileTime: 373.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 910.739ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 2s982ms SORT_NODE (id=16):(Total: 24.485ms, non-child: 42.344us, % non-child: 0.17%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 24.443ms, non-child: 24.443ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d8 (host=vc1534.foo.com:22000):(Total: 2s522ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 190.63 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.84 GB (6274962606) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 2s522ms - ExecTreePrepareTime: 417.543us KrpcDataStreamSender (dst_id=28):(Total: 148.738ms, non-child: 148.738ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 3s234ms, non-child: 3s234ms, % non-child: 100.00%) - CodegenTime: 37.376ms - CompileTime: 263.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 614.566ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 2s315ms SORT_NODE (id=16):(Total: 416.698us, non-child: 34.172us, % non-child: 8.20%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 382.526us, non-child: 382.526us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ed (host=vc1507.foo.com:22000):(Total: 2s287ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 236.21 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.86 GB (6290305442) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 2s287ms - ExecTreePrepareTime: 15.558ms KrpcDataStreamSender (dst_id=28):(Total: 918.864us, non-child: 918.864us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 3s448ms, non-child: 3s448ms, % non-child: 100.00%) - CodegenTime: 400.880ms - CompileTime: 455.498ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 983.650ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 1s426ms SORT_NODE (id=16):(Total: 15.557ms, non-child: 38.643us, % non-child: 0.25%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 15.519ms, non-child: 15.519ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d7 (host=vc1532.foo.com:22000):(Total: 1s548ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 192.17 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.60 GB (6008765390) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s547ms - ExecTreePrepareTime: 17.430ms KrpcDataStreamSender (dst_id=28):(Total: 20.899ms, non-child: 20.899ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s983ms, non-child: 1s983ms, % non-child: 100.00%) - CodegenTime: 71.713ms - CompileTime: 133.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 392.988ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 1s436ms SORT_NODE (id=16):(Total: 17.429ms, non-child: 39.300us, % non-child: 0.23%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 17.390ms, non-child: 17.390ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e4 (host=vc1523.foo.com:22000):(Total: 1s257ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 238.00 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.87 GB (6297722034) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s257ms - ExecTreePrepareTime: 8.094ms KrpcDataStreamSender (dst_id=28):(Total: 1.462ms, non-child: 1.462ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 2s489ms, non-child: 2s489ms, % non-child: 100.00%) - CodegenTime: 109.801ms - CompileTime: 450.954ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 725.779ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 1s268ms SORT_NODE (id=16):(Total: 8.093ms, non-child: 28.872us, % non-child: 0.36%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 8.064ms, non-child: 8.064ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000db (host=vc1524.foo.com:22000):(Total: 1s246ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 192.42 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.94 GB (6381855558) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s246ms - ExecTreePrepareTime: 396.448us KrpcDataStreamSender (dst_id=28):(Total: 50.168ms, non-child: 50.168ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 2s037ms, non-child: 2s037ms, % non-child: 100.00%) - CodegenTime: 49.421ms - CompileTime: 187.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 636.528ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 1s126ms SORT_NODE (id=16):(Total: 395.298us, non-child: 34.770us, % non-child: 8.80%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 360.528us, non-child: 360.528us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d5 (host=vc1539.foo.com:22000):(Total: 980.085ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 192.77 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.62 GB (6037536077) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 980.009ms - ExecTreePrepareTime: 36.084ms KrpcDataStreamSender (dst_id=28):(Total: 7.049ms, non-child: 7.049ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s801ms, non-child: 1s801ms, % non-child: 100.00%) - CodegenTime: 52.473ms - CompileTime: 192.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 655.971ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 867.552ms SORT_NODE (id=16):(Total: 36.082ms, non-child: 41.917us, % non-child: 0.12%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 36.040ms, non-child: 36.040ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e1 (host=vc1537.foo.com:22000):(Total: 891.535ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 147.10 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.70 GB (6125001106) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 891.472ms - ExecTreePrepareTime: 16.725ms KrpcDataStreamSender (dst_id=28):(Total: 1.070ms, non-child: 1.070ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s602ms, non-child: 1s602ms, % non-child: 100.00%) - CodegenTime: 21.602ms - CompileTime: 243.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 496.423ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 824.947ms SORT_NODE (id=16):(Total: 16.724ms, non-child: 33.208us, % non-child: 0.20%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 16.690ms, non-child: 16.690ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ce (host=vc1504.foo.com:22000):(Total: 791.314ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 147.10 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.60 GB (6015299737) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 791.259ms - ExecTreePrepareTime: 71.529ms KrpcDataStreamSender (dst_id=28):(Total: 636.700us, non-child: 636.700us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s360ms, non-child: 1s360ms, % non-child: 100.00%) - CodegenTime: 44.427ms - CompileTime: 193.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 471.959ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 690.128ms SORT_NODE (id=16):(Total: 71.528ms, non-child: 27.241us, % non-child: 0.04%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 71.500ms, non-child: 71.500ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e3 (host=vc1517.foo.com:22000):(Total: 759.950ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 192.77 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.61 GB (6028779656) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 759.898ms - ExecTreePrepareTime: 104.141ms KrpcDataStreamSender (dst_id=28):(Total: 20.792ms, non-child: 20.792ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s242ms, non-child: 1s242ms, % non-child: 100.00%) - CodegenTime: 36.645ms - CompileTime: 149.583ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 460.983ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 628.079ms SORT_NODE (id=16):(Total: 104.140ms, non-child: 39.313us, % non-child: 0.04%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 104.100ms, non-child: 104.100ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e0 (host=vc1536.foo.com:22000):(Total: 544.217ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.02 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.83 GB (6261922353) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 544.150ms - ExecTreePrepareTime: 20.624ms KrpcDataStreamSender (dst_id=28):(Total: 2.767ms, non-child: 2.767ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s347ms, non-child: 1s347ms, % non-child: 100.00%) - CodegenTime: 63.822ms - CompileTime: 372.839ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 542.873ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 408.490ms SORT_NODE (id=16):(Total: 20.623ms, non-child: 35.784us, % non-child: 0.17%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 20.587ms, non-child: 20.587ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000cb (host=vc1515.foo.com:22000):(Total: 458.110ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.02 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.62 GB (6034150474) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 458.020ms - ExecTreePrepareTime: 768.667us KrpcDataStreamSender (dst_id=28):(Total: 3.408ms, non-child: 3.408ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s343ms, non-child: 1s343ms, % non-child: 100.00%) - CodegenTime: 74.216ms - CompileTime: 252.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 645.716ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 436.178ms SORT_NODE (id=16):(Total: 767.151us, non-child: 42.323us, % non-child: 5.52%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 724.828us, non-child: 724.828us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ee (host=vc1535.foo.com:22000):(Total: 332.626ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.62 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.78 GB (6210496595) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 332.556ms - ExecTreePrepareTime: 3.835ms KrpcDataStreamSender (dst_id=28):(Total: 8.537ms, non-child: 8.537ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s052ms, non-child: 1s052ms, % non-child: 100.00%) - CodegenTime: 34.239ms - CompileTime: 259.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 499.328ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 279.607ms SORT_NODE (id=16):(Total: 3.834ms, non-child: 44.476us, % non-child: 1.16%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 3.789ms, non-child: 3.789ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e5 (host=vc1541.foo.com:22000):(Total: 331.770ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.37 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6393122868) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 331.711ms - ExecTreePrepareTime: 20.053ms KrpcDataStreamSender (dst_id=28):(Total: 23.630ms, non-child: 23.630ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 909.050ms, non-child: 909.050ms, % non-child: 100.00%) - CodegenTime: 9.435ms - CompileTime: 169.978ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 435.590ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 281.868ms SORT_NODE (id=16):(Total: 20.052ms, non-child: 31.678us, % non-child: 0.16%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 20.020ms, non-child: 20.020ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d3 (host=vc1516.foo.com:22000):(Total: 326.349ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.37 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.80 GB (6223176828) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 326.275ms - ExecTreePrepareTime: 7.267ms KrpcDataStreamSender (dst_id=28):(Total: 4.251ms, non-child: 4.251ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s062ms, non-child: 1s062ms, % non-child: 100.00%) - CodegenTime: 49.664ms - CompileTime: 204.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 517.864ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 322.909ms SORT_NODE (id=16):(Total: 7.266ms, non-child: 32.890us, % non-child: 0.45%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 7.233ms, non-child: 7.233ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d2 (host=vc1511.foo.com:22000):(Total: 281.952ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.62 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.66 GB (6078717216) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 281.866ms - ExecTreePrepareTime: 5.973ms KrpcDataStreamSender (dst_id=28):(Total: 705.829us, non-child: 705.829us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s001ms, non-child: 1s001ms, % non-child: 100.00%) - CodegenTime: 20.888ms - CompileTime: 189.653ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 530.816ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 262.383ms SORT_NODE (id=16):(Total: 5.972ms, non-child: 40.927us, % non-child: 0.69%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 5.931ms, non-child: 5.931ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000cc (host=vc1538.foo.com:22000):(Total: 253.196ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.37 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.72 GB (6136663554) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 253.112ms - ExecTreePrepareTime: 22.624ms KrpcDataStreamSender (dst_id=28):(Total: 18.557ms, non-child: 18.557ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 969.645ms, non-child: 969.645ms, % non-child: 100.00%) - CodegenTime: 23.803ms - CompileTime: 166.944ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 588.039ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 203.433ms SORT_NODE (id=16):(Total: 22.622ms, non-child: 36.544us, % non-child: 0.16%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 22.586ms, non-child: 22.586ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d0 (host=vc1529.foo.com:22000):(Total: 231.508ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.65 GB (6064879444) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 231.460ms - ExecTreePrepareTime: 2.973ms KrpcDataStreamSender (dst_id=28):(Total: 351.893us, non-child: 351.893us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 889.060ms, non-child: 889.060ms, % non-child: 100.00%) - CodegenTime: 21.536ms - CompileTime: 158.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 505.075ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 187.746ms SORT_NODE (id=16):(Total: 2.972ms, non-child: 18.543us, % non-child: 0.62%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 2.954ms, non-child: 2.954ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000cf (host=vc1527.foo.com:22000):(Total: 211.026ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 147.69 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.75 GB (6176310846) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 210.928ms - ExecTreePrepareTime: 376.745us KrpcDataStreamSender (dst_id=28):(Total: 1.829ms, non-child: 1.829ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 906.283ms, non-child: 906.283ms, % non-child: 100.00%) - CodegenTime: 13.199ms - CompileTime: 212.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 471.386ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 212.665ms SORT_NODE (id=16):(Total: 375.804us, non-child: 24.561us, % non-child: 6.54%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 351.243us, non-child: 351.243us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000dc (host=vc1525.foo.com:22000):(Total: 202.228ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.62 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.98 GB (6415986324) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 202.168ms - ExecTreePrepareTime: 770.642us KrpcDataStreamSender (dst_id=28):(Total: 7.182ms, non-child: 7.182ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 924.294ms, non-child: 924.294ms, % non-child: 100.00%) - CodegenTime: 30.355ms - CompileTime: 174.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 531.435ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 203.322ms SORT_NODE (id=16):(Total: 769.777us, non-child: 22.235us, % non-child: 2.89%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 747.542us, non-child: 747.542us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e8 (host=vc1520.foo.com:22000):(Total: 191.247ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.68 GB (6098657737) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 191.188ms - ExecTreePrepareTime: 1.421ms KrpcDataStreamSender (dst_id=28):(Total: 13.348ms, non-child: 13.348ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 721.835ms, non-child: 721.835ms, % non-child: 100.00%) - CodegenTime: 19.268ms - CompileTime: 181.313ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 368.594ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 166.915ms SORT_NODE (id=16):(Total: 1.420ms, non-child: 30.978us, % non-child: 2.18%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 1.389ms, non-child: 1.389ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ef (host=vc1540.foo.com:22000):(Total: 189.328ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.93 GB (6370250980) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 189.278ms - ExecTreePrepareTime: 2.847ms KrpcDataStreamSender (dst_id=28):(Total: 589.399us, non-child: 589.399us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 720.974ms, non-child: 720.974ms, % non-child: 100.00%) - CodegenTime: 18.225ms - CompileTime: 142.426ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 393.766ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 178.403ms SORT_NODE (id=16):(Total: 2.846ms, non-child: 30.335us, % non-child: 1.07%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 2.816ms, non-child: 2.816ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ec (host=vc1503.foo.com:22000):(Total: 181.370ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 147.44 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.93 GB (6363912646) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 181.314ms - ExecTreePrepareTime: 7.637ms KrpcDataStreamSender (dst_id=28):(Total: 555.541us, non-child: 555.541us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 619.643ms, non-child: 619.643ms, % non-child: 100.00%) - CodegenTime: 31.971ms - CompileTime: 124.366ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 327.785ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 165.281ms SORT_NODE (id=16):(Total: 7.635ms, non-child: 29.521us, % non-child: 0.39%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 7.606ms, non-child: 7.606ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d9 (host=vc1508.foo.com:22000):(Total: 167.075ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.82 GB (6248166158) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 167.016ms - ExecTreePrepareTime: 6.550ms KrpcDataStreamSender (dst_id=28):(Total: 1.611ms, non-child: 1.611ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 687.934ms, non-child: 687.934ms, % non-child: 100.00%) - CodegenTime: 26.499ms - CompileTime: 112.088ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 428.602ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 133.434ms SORT_NODE (id=16):(Total: 6.548ms, non-child: 32.131us, % non-child: 0.49%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 6.516ms, non-child: 6.516ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000cd (host=vc1519.foo.com:22000):(Total: 163.975ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.37 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.72 GB (6146531921) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 163.930ms - ExecTreePrepareTime: 6.242ms KrpcDataStreamSender (dst_id=28):(Total: 1.083ms, non-child: 1.083ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 740.625ms, non-child: 740.625ms, % non-child: 100.00%) - CodegenTime: 15.787ms - CompileTime: 143.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 447.727ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 145.134ms SORT_NODE (id=16):(Total: 6.241ms, non-child: 38.640us, % non-child: 0.62%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 6.203ms, non-child: 6.203ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d1 (host=vc1526.foo.com:22000):(Total: 157.765ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.65 GB (6064123940) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 157.683ms - ExecTreePrepareTime: 1.182ms KrpcDataStreamSender (dst_id=28):(Total: 5.631ms, non-child: 5.631ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 725.588ms, non-child: 725.588ms, % non-child: 100.00%) - CodegenTime: 26.983ms - CompileTime: 165.126ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 427.279ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 123.410ms SORT_NODE (id=16):(Total: 1.181ms, non-child: 41.997us, % non-child: 3.55%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 1.139ms, non-child: 1.139ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e2 (host=vc1502.foo.com:22000):(Total: 152.384ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.86 GB (6287209153) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 152.261ms - ExecTreePrepareTime: 618.547us KrpcDataStreamSender (dst_id=28):(Total: 4.099ms, non-child: 4.099ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 693.724ms, non-child: 693.724ms, % non-child: 100.00%) - CodegenTime: 17.003ms - CompileTime: 129.214ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 420.032ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 131.713ms SORT_NODE (id=16):(Total: 617.628us, non-child: 36.697us, % non-child: 5.94%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 580.931us, non-child: 580.931us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e6 (host=vc1531.foo.com:22000):(Total: 150.736ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.88 GB (6310722825) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 150.649ms - ExecTreePrepareTime: 3.331ms KrpcDataStreamSender (dst_id=28):(Total: 3.416ms, non-child: 3.416ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 718.458ms, non-child: 718.458ms, % non-child: 100.00%) - CodegenTime: 37.408ms - CompileTime: 162.593ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 430.266ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 121.931ms SORT_NODE (id=16):(Total: 3.330ms, non-child: 32.875us, % non-child: 0.99%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 3.297ms, non-child: 3.297ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000ea (host=vc1501.foo.com:22000):(Total: 145.167ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.37 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.80 GB (6227541500) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 145.081ms - ExecTreePrepareTime: 9.233ms KrpcDataStreamSender (dst_id=28):(Total: 629.321us, non-child: 629.321us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 757.548ms, non-child: 757.548ms, % non-child: 100.00%) - CodegenTime: 12.394ms - CompileTime: 217.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 421.224ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 116.133ms SORT_NODE (id=16):(Total: 9.233ms, non-child: 38.314us, % non-child: 0.41%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 9.194ms, non-child: 9.194ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e7 (host=vc1533.foo.com:22000):(Total: 143.043ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.89 GB (6324628770) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 142.979ms - ExecTreePrepareTime: 1.903ms KrpcDataStreamSender (dst_id=28):(Total: 1.964ms, non-child: 1.964ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 661.974ms, non-child: 661.974ms, % non-child: 100.00%) - CodegenTime: 14.614ms - CompileTime: 144.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 379.306ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 136.330ms SORT_NODE (id=16):(Total: 1.902ms, non-child: 36.096us, % non-child: 1.90%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 1.866ms, non-child: 1.866ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000d4 (host=vc1513.foo.com:22000):(Total: 126.057ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.93 GB (6365035797) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 125.998ms - ExecTreePrepareTime: 17.968ms KrpcDataStreamSender (dst_id=28):(Total: 518.857us, non-child: 518.857us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 810.584ms, non-child: 810.584ms, % non-child: 100.00%) - CodegenTime: 21.648ms - CompileTime: 186.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 511.071ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 109.984ms SORT_NODE (id=16):(Total: 17.966ms, non-child: 49.928us, % non-child: 0.28%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 17.917ms, non-child: 17.917ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000da (host=vc1505.foo.com:22000):(Total: 107.295ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.78 GB (6209412241) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 107.235ms - ExecTreePrepareTime: 482.234us KrpcDataStreamSender (dst_id=28):(Total: 1.220ms, non-child: 1.220ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 456.863ms, non-child: 456.863ms, % non-child: 100.00%) - CodegenTime: 43.439ms - CompileTime: 85.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 287.316ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 82.086ms SORT_NODE (id=16):(Total: 481.366us, non-child: 23.899us, % non-child: 4.96%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 457.467us, non-child: 457.467us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000e9 (host=vc1522.foo.com:22000):(Total: 105.626ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.74 GB (6160142347) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 105.542ms - ExecTreePrepareTime: 365.469us KrpcDataStreamSender (dst_id=28):(Total: 1.912ms, non-child: 1.912ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 590.634ms, non-child: 590.634ms, % non-child: 100.00%) - CodegenTime: 22.078ms - CompileTime: 116.172ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 386.639ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 85.866ms SORT_NODE (id=16):(Total: 364.469us, non-child: 29.137us, % non-child: 7.99%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 335.332us, non-child: 335.332us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000df (host=vc1518.foo.com:22000):(Total: 90.866ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.89 GB (6324015351) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 90.819ms - ExecTreePrepareTime: 680.154us KrpcDataStreamSender (dst_id=28):(Total: 483.380us, non-child: 483.380us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 512.364ms, non-child: 512.364ms, % non-child: 100.00%) - CodegenTime: 27.208ms - CompileTime: 96.527ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 344.774ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 64.669ms SORT_NODE (id=16):(Total: 679.698us, non-child: 17.879us, % non-child: 2.63%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 661.819us, non-child: 661.819us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000dd (host=vc1510.foo.com:22000):(Total: 85.990ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 148.04 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.85 GB (6277483876) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 85.924ms - ExecTreePrepareTime: 382.965us KrpcDataStreamSender (dst_id=28):(Total: 7.239ms, non-child: 7.239ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 503.438ms, non-child: 503.438ms, % non-child: 100.00%) - CodegenTime: 12.413ms - CompileTime: 125.850ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 297.028ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 67.881ms SORT_NODE (id=16):(Total: 381.995us, non-child: 31.482us, % non-child: 8.24%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 350.513us, non-child: 350.513us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Instance b04615c310d227c4:32700373000000de (host=vc1528.foo.com:22000):(Total: 66.837ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 193.96 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB, 148.39 KB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.57 MB (1645376) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.64 GB (6057606425) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.769ms - ExecTreePrepareTime: 684.874us KrpcDataStreamSender (dst_id=28):(Total: 791.948us, non-child: 791.948us, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 53.19 KB (54464) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 429.165ms, non-child: 429.165ms, % non-child: 100.00%) - CodegenTime: 16.374ms - CompileTime: 85.120ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 2.94K (2939) - OptimizationTime: 283.272ms - PeakMemoryUsage: 1.44 MB (1504768) - PrepareTime: 58.814ms SORT_NODE (id=16):(Total: 682.222us, non-child: 27.250us, % non-child: 3.99%) SortType: TopN ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - TuplePoolReclamations: 0 (0) AGGREGATION_NODE (id=27):(Total: 654.972us, non-child: 654.972us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 RecvrSide: BytesReceived(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 0 - TotalGetBatchTime: 0.000ns - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 0.000ns - NumBatchesAccepted: 0 (0) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) Averaged Fragment F07:(Total: 34s554ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:10m22s max:10m23s mean: 10m23s stddev:256.960ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 37 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2098480) - PeakMemoryUsage: 5.72 GB (6136856320) - PeakReservation: 105.66 MB (110791264) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.82 GB (6253701407) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 184 (184) - TotalThreadsTotalWallClockTime: 33s591ms - TotalThreadsSysTime: 7.593ms - TotalThreadsUserTime: 1s274ms - TotalThreadsVoluntaryContextSwitches: 373 (373) Fragment Instance Lifecycle Timings: - OpenTime: 33s591ms - ExecTreeOpenTime: 33s510ms - PrepareTime: 963.026ms - ExecTreePrepareTime: 85.638ms KrpcDataStreamSender (dst_id=26):(Total: 547.195ms, non-child: 547.195ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s446ms, non-child: 1s446ms, % non-child: 100.00%) - CodegenTime: 4.220ms - CompileTime: 429.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8482) - OptimizationTime: 757.857ms - PeakMemoryUsage: 4.14 MB (4343157) - PrepareTime: 247.909ms AGGREGATION_NODE (id=15):(Total: 33s595ms, non-child: 0.000ns, % non-child: 0.00%) - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 33s657ms, non-child: 3.255ms, % non-child: 0.01%) - BuildRows: 1.50K (1500) - BuildTime: 51.445ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 45.044ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 47.491ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.702ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s913ms, non-child: 2s913ms, % non-child: 100.00%) - ConvertRowBatchTime: 46.491us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 1.79 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s913ms - DataArrivalTimer: 2s913ms SenderSide: - DeserializeRowBatchTime: 30.226ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 33s454ms, non-child: 5.681ms, % non-child: 0.02%) - BuildRows: 1.10K (1096) - BuildTime: 52.431ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 49.566ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): - BuildRowsPartitionTime: 47.631ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.523ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 412.921ms, non-child: 412.921ms, % non-child: 100.00%) - ConvertRowBatchTime: 31.486us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 15.03 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 412.880ms - DataArrivalTimer: 412.874ms SenderSide: - DeserializeRowBatchTime: 1.064ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m42s, non-child: 1s123ms, % non-child: 0.40%) - BuildRows: 301.44K (301440) - BuildTime: 594.381ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 101.91 MB (106863456) - ProbeRows: 120.55M (120551562) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s488ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): - BuildRowsPartitionTime: 457.307ms - BuildRowsPartitioned: 301.44K (301440) - HashBuckets: 549.09K (549085) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.597ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 4m22s, % non-child: 100.00%) - ConvertRowBatchTime: 10.392ms - PeakMemoryUsage: 0 - RowsReturned: 301.44K (301440) - RowsReturnedRate: 1.15 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 82.05 MB (86036299) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 817.122ms - NumBatchesAccepted: 94 (94) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m21s, non-child: 5m21s, % non-child: 100.00%) - ConvertRowBatchTime: 2s935ms - PeakMemoryUsage: 0 - RowsReturned: 120.55M (120551975) - RowsReturnedRate: 374.63 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.71 GB (3978499095) - TotalGetBatchTime: 5m18s - DataArrivalTimer: 5m14s SenderSide: - DeserializeRowBatchTime: 1m59s - NumBatchesAccepted: 5.75K (5748) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 121.761ms - CumulativeAllocationBytes: 101.78 MB (106728032) - CumulativeAllocations: 50 (50) - PeakReservation: 101.78 MB (106728032) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 101.78 MB (106728032) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F07: Instance b04615c310d227c4:32700373000000c0 (host=vc1541.foo.com:22000):(Total: 10m22s, non-child: 58.135ms, % non-child: 0.01%) MemoryUsage(16s000ms): 16.72 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 21.59 MB, 91.10 MB, 96.39 MB, 107.57 MB, 143.70 MB, 245.76 MB, 473.82 MB, 760.32 MB, 1.05 GB, 1.38 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.41 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.79 GB, 5.09 GB, 5.39 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.88 GB (6316466012) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.00 GB (6442934023) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.35K (3346) - TotalThreadsTotalWallClockTime: 10m21s - TotalThreadsSysTime: 158.976ms - TotalThreadsUserTime: 23s386ms - TotalThreadsVoluntaryContextSwitches: 6.94K (6943) Fragment Instance Lifecycle Timings: - OpenTime: 10m21s - ExecTreeOpenTime: 10m20s - PrepareTime: 430.224ms - ExecTreePrepareTime: 63.978ms KrpcDataStreamSender (dst_id=26):(Total: 166.180ms, non-child: 166.180ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s969ms, non-child: 1s969ms, % non-child: 100.00%) - CodegenTime: 3.627ms - CompileTime: 1s055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 759.581ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 133.565ms AGGREGATION_NODE (id=15):(Total: 10m20s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 10m20s, non-child: 75.023ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 74.245ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 72.905ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 73.550ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 434.979us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s415ms, non-child: 59.997us, % non-child: 0.00%) - ConvertRowBatchTime: 42.889us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 439.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s415ms - DataArrivalTimer: 3s415ms SenderSide: - DeserializeRowBatchTime: 167.859ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 10m16s, non-child: 141.448ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 20.525ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 19.775ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 19.938ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 319.228us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 48.331us, non-child: 48.331us, % non-child: 100.00%) - ConvertRowBatchTime: 33.213us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 22.68 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.668us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 13.736ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 10m16s, non-child: 19s783ms, % non-child: 3.21%) ExecOption: Probe Side Codegen Enabled - BuildRows: 302.72K (302722) - BuildTime: 538.579ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 124.08M (124083200) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s828ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 450.736ms - BuildRowsPartitioned: 302.72K (302722) - HashBuckets: 589.82K (589824) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.827ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m24s, non-child: 32.324ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.828ms - PeakMemoryUsage: 0 - RowsReturned: 302.72K (302722) - RowsReturnedRate: 1.15 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 422.59 KB, 36.14 MB, 40.75 MB, 40.75 MB, 40.75 MB, 47.43 MB, 66.97 MB, 78.29 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 82.10 MB (86089631) - TotalGetBatchTime: 4m24s - DataArrivalTimer: 4m24s SenderSide: - DeserializeRowBatchTime: 727.624ms - NumBatchesAccepted: 103 (103) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m32s, non-child: 9s448ms, % non-child: 2.84%) - ConvertRowBatchTime: 3s039ms - PeakMemoryUsage: 0 - RowsReturned: 124.08M (124083200) - RowsReturnedRate: 373.33 K/sec RecvrSide: BytesReceived(16s000ms): 8.70 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 13.08 MB, 90.83 MB, 241.70 MB, 430.76 MB, 641.32 MB, 864.95 MB, 1.05 GB, 1.22 GB, 1.36 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.81 GB (4094818431) - TotalGetBatchTime: 5m29s - DataArrivalTimer: 5m22s SenderSide: - DeserializeRowBatchTime: 2m14s - NumBatchesAccepted: 5.92K (5917) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 105.467ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000be (host=vc1517.foo.com:22000):(Total: 10m22s, non-child: 72.882ms, % non-child: 0.01%) MemoryUsage(16s000ms): 17.71 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 22.29 MB, 89.36 MB, 94.64 MB, 98.69 MB, 134.06 MB, 248.34 MB, 478.07 MB, 764.48 MB, 1.06 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.79 GB, 5.08 GB, 5.39 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.88 GB (6314106836) - PeakReservation: 103.88 MB (108920832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.00 GB (6443192494) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.47K (3467) - TotalThreadsTotalWallClockTime: 10m21s - TotalThreadsSysTime: 121.982ms - TotalThreadsUserTime: 23s775ms - TotalThreadsVoluntaryContextSwitches: 6.86K (6864) Fragment Instance Lifecycle Timings: - OpenTime: 10m21s - ExecTreeOpenTime: 10m19s - PrepareTime: 994.314ms - ExecTreePrepareTime: 321.571ms KrpcDataStreamSender (dst_id=26):(Total: 439.612ms, non-child: 439.612ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s351ms, non-child: 1s351ms, % non-child: 100.00%) - CodegenTime: 3.583ms - CompileTime: 377.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 802.417ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 169.794ms AGGREGATION_NODE (id=15):(Total: 10m20s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 10m20s, non-child: 24.405ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 12.277ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 11.018ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 11.618ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 485.709us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s269ms, non-child: 56.164us, % non-child: 0.00%) - ConvertRowBatchTime: 35.444us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 458.00 /sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s269ms - DataArrivalTimer: 3s269ms SenderSide: - DeserializeRowBatchTime: 2.447ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 10m17s, non-child: 68.767ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 2.399ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 1.832ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1.943ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 148.047us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 40.865us, non-child: 40.865us, % non-child: 100.00%) - ConvertRowBatchTime: 29.885us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 26.82 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 4.976us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 40.800us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 10m17s, non-child: 21s802ms, % non-child: 3.53%) ExecOption: Probe Side Codegen Enabled - BuildRows: 296.77K (296774) - BuildTime: 824.552ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 100.13 MB (104993024) - ProbeRows: 124.13M (124127232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s161ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 708.942ms - BuildRowsPartitioned: 296.77K (296774) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.899ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 53.284ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.169ms - PeakMemoryUsage: 0 - RowsReturned: 296.77K (296774) - RowsReturnedRate: 1.12 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 425.05 KB, 36.04 MB, 40.95 MB, 40.95 MB, 40.95 MB, 40.95 MB, 45.79 MB, 67.89 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 80.78 MB (84704742) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 475.824ms - NumBatchesAccepted: 79 (79) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m31s, non-child: 8s475ms, % non-child: 2.56%) - ConvertRowBatchTime: 3s031ms - PeakMemoryUsage: 0 - RowsReturned: 124.13M (124127349) - RowsReturnedRate: 374.31 K/sec RecvrSide: BytesReceived(16s000ms): 8.91 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 12.42 MB, 94.77 MB, 246.81 MB, 436.06 MB, 648.87 MB, 871.74 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.82 GB (4096894560) - TotalGetBatchTime: 5m28s - DataArrivalTimer: 5m23s SenderSide: - DeserializeRowBatchTime: 2m16s - NumBatchesAccepted: 5.92K (5920) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 38.705ms - CumulativeAllocationBytes: 100.00 MB (104857600) - CumulativeAllocations: 50 (50) - PeakReservation: 100.00 MB (104857600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 100.00 MB (104857600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c6 (host=vc1509.foo.com:22000):(Total: 5s404ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 14.21 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 18.39 MB, 21.35 MB, 94.35 MB, 98.14 MB, 104.27 MB, 126.33 MB, 246.83 MB, 475.73 MB, 765.70 MB, 1.06 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.65 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.59 GB (6007136092) - PeakReservation: 101.88 MB (106823680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.71 GB (6129713430) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 5s404ms - ExecTreePrepareTime: 29.769ms KrpcDataStreamSender (dst_id=26):(Total: 3s624ms, non-child: 3s624ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 3s182ms, non-child: 3s182ms, % non-child: 100.00%) - CodegenTime: 3.111ms - CompileTime: 566.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 1s096ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 1s507ms AGGREGATION_NODE (id=15):(Total: 29.768ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 59.156ms, non-child: 579.541us, % non-child: 0.98%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 96.125ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 94.610ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 76.964ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 18.924ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 70.582us, non-child: 70.582us, % non-child: 100.00%) - ConvertRowBatchTime: 54.104us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 21.25 M/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 6.665us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 195.600ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 58.506ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 127.970ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 127.003ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 101.874ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.832ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 54.435us, non-child: 54.435us, % non-child: 100.00%) - ConvertRowBatchTime: 35.863us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 20.13 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.799us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 43.724us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m27s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 297.46K (297459) - BuildTime: 510.053ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 98.13 MB (102895872) - ProbeRows: 118.00M (118003712) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s870ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 250.397ms - BuildRowsPartitioned: 297.46K (297459) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 68.607ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m26s, non-child: 36.246ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.473ms - PeakMemoryUsage: 0 - RowsReturned: 297.46K (297459) - RowsReturnedRate: 1.12 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.38 MB, 37.16 MB, 40.81 MB, 40.81 MB, 40.81 MB, 41.56 MB, 44.37 MB, 60.66 MB, 77.24 MB - FirstBatchArrivalWaitTime: 3m20s - TotalBytesReceived: 80.67 MB (84585783) - TotalGetBatchTime: 4m26s - DataArrivalTimer: 4m26s SenderSide: - DeserializeRowBatchTime: 610.616ms - NumBatchesAccepted: 77 (77) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m8s, non-child: 8s384ms, % non-child: 2.71%) - ConvertRowBatchTime: 2s846ms - PeakMemoryUsage: 0 - RowsReturned: 118.00M (118003817) - RowsReturnedRate: 382.07 K/sec RecvrSide: BytesReceived(16s000ms): 7.75 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 94.67 MB, 246.65 MB, 438.46 MB, 652.64 MB, 876.27 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.63 GB (3894818004) - TotalGetBatchTime: 5m5s - DataArrivalTimer: 5m SenderSide: - DeserializeRowBatchTime: 2m5s - NumBatchesAccepted: 5.63K (5628) - NumBatchesDeferred: 52 (52) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 27.912ms - CumulativeAllocationBytes: 98.00 MB (102760448) - CumulativeAllocations: 49 (49) - PeakReservation: 98.00 MB (102760448) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 98.00 MB (102760448) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b1 (host=vc1542.foo.com:22000):(Total: 4s105ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 15.53 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 24.41 MB, 102.73 MB, 105.95 MB, 122.57 MB, 154.94 MB, 265.32 MB, 488.58 MB, 784.07 MB, 1.08 GB, 1.42 GB, 1.73 GB, 1.97 GB, 2.19 GB, 2.43 GB, 2.68 GB, 2.93 GB, 3.17 GB, 3.42 GB, 3.67 GB, 3.93 GB, 4.22 GB, 4.49 GB, 4.80 GB, 5.10 GB, 5.41 GB, 5.63 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.84 GB (6269804332) - PeakReservation: 109.88 MB (115212288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.94 GB (6383172455) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 4s105ms - ExecTreePrepareTime: 81.899ms KrpcDataStreamSender (dst_id=26):(Total: 3s098ms, non-child: 3s098ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 2s468ms, non-child: 2s468ms, % non-child: 100.00%) - CodegenTime: 2.966ms - CompileTime: 697.058ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 1s114ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 609.029ms AGGREGATION_NODE (id=15):(Total: 81.897ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 163.235ms, non-child: 19.857ms, % non-child: 12.16%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 8.546ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.521ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 7.968ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 311.455us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 56.533us, non-child: 56.533us, % non-child: 100.00%) - ConvertRowBatchTime: 39.242us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 26.53 M/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 7.777us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 139.432ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=13):(Total: 143.321ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 578.369us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 5.493us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 105.419us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 164.184us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 37.392us, non-child: 37.392us, % non-child: 100.00%) - ConvertRowBatchTime: 25.243us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 29.31 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.294us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 80.762us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m21s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 305.37K (305371) - BuildTime: 563.328ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 106.13 MB (111284480) - ProbeRows: 123.10M (123099136) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s847ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 458.586ms - BuildRowsPartitioned: 305.37K (305371) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.867ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m20s, non-child: 119.921ms, % non-child: 0.05%) - ConvertRowBatchTime: 10.625ms - PeakMemoryUsage: 0 - RowsReturned: 305.37K (305371) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.58 MB, 39.81 MB, 41.28 MB, 41.28 MB, 45.95 MB, 59.56 MB, 77.67 MB, 82.57 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.91 MB (87981287) - TotalGetBatchTime: 4m20s - DataArrivalTimer: 4m20s SenderSide: - DeserializeRowBatchTime: 1s806ms - NumBatchesAccepted: 109 (109) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m31s, non-child: 10s110ms, % non-child: 3.05%) - ConvertRowBatchTime: 2s991ms - PeakMemoryUsage: 0 - RowsReturned: 123.10M (123099770) - RowsReturnedRate: 371.01 K/sec RecvrSide: BytesReceived(16s000ms): 8.33 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 18.87 MB, 102.36 MB, 249.87 MB, 444.97 MB, 658.02 MB, 884.38 MB, 1.07 GB, 1.23 GB, 1.37 GB, 1.53 GB, 1.70 GB, 1.87 GB, 2.02 GB, 2.19 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.30 GB, 3.50 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.78 GB (4062292410) - TotalGetBatchTime: 5m28s - DataArrivalTimer: 5m21s SenderSide: - DeserializeRowBatchTime: 2m24s - NumBatchesAccepted: 5.87K (5870) - NumBatchesDeferred: 25 (25) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 173.983ms - CumulativeAllocationBytes: 106.00 MB (111149056) - CumulativeAllocations: 53 (53) - PeakReservation: 106.00 MB (111149056) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 106.00 MB (111149056) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c8 (host=vc1507.foo.com:22000):(Total: 3s281ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 15.92 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 18.90 MB, 20.18 MB, 91.84 MB, 97.71 MB, 109.89 MB, 139.82 MB, 248.05 MB, 477.02 MB, 764.27 MB, 1.06 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.78 GB, 5.08 GB, 5.39 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.82 GB (6250152116) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.92 GB (6354640934) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 3s281ms - ExecTreePrepareTime: 25.678ms KrpcDataStreamSender (dst_id=26):(Total: 2s267ms, non-child: 2s267ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 2s188ms, non-child: 2s188ms, % non-child: 100.00%) - CodegenTime: 2.981ms - CompileTime: 512.299ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 177 (177) - NumInstructions: 8.54K (8537) - OptimizationTime: 862.931ms - PeakMemoryUsage: 4.17 MB (4370944) - PrepareTime: 765.061ms AGGREGATION_NODE (id=15):(Total: 25.677ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 50.899ms, non-child: 585.425us, % non-child: 1.15%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 13.339ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 12.158ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 12.732ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 311.704us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 80.980us, non-child: 80.980us, % non-child: 100.00%) - ConvertRowBatchTime: 64.655us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 18.52 M/sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 6.090us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 111.355ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 50.233ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 16.006ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 14.982ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.265ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 368.199us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 55.104us, non-child: 55.104us, % non-child: 100.00%) - ConvertRowBatchTime: 38.626us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 19.89 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 8.263us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 42.441us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m29s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 303.55K (303550) - BuildTime: 592.112ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 122.83M (122826752) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s571ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 495.588ms - BuildRowsPartitioned: 303.55K (303550) - HashBuckets: 589.82K (589824) - HashCollisions: 0 (0) - HashTablesBuildTime: 51.292ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m28s, non-child: 76.781ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.860ms - PeakMemoryUsage: 0 - RowsReturned: 303.55K (303550) - RowsReturnedRate: 1.13 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 283.85 KB, 36.99 MB, 40.93 MB, 40.93 MB, 42.25 MB, 54.83 MB, 65.98 MB, 75.39 MB, 82.47 MB - FirstBatchArrivalWaitTime: 3m23s - TotalBytesReceived: 82.65 MB (86662070) - TotalGetBatchTime: 4m28s - DataArrivalTimer: 4m28s SenderSide: - DeserializeRowBatchTime: 924.461ms - NumBatchesAccepted: 104 (104) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m24s, non-child: 7s633ms, % non-child: 2.36%) - ConvertRowBatchTime: 2s982ms - PeakMemoryUsage: 0 - RowsReturned: 122.83M (122827147) - RowsReturnedRate: 378.96 K/sec RecvrSide: BytesReceived(16s000ms): 8.44 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 91.92 MB, 244.81 MB, 434.52 MB, 646.78 MB, 870.70 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.77 GB (4053295851) - TotalGetBatchTime: 5m21s - DataArrivalTimer: 5m16s SenderSide: - DeserializeRowBatchTime: 2m1s - NumBatchesAccepted: 5.86K (5857) - NumBatchesDeferred: 45 (45) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 100.495ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b3 (host=vc1534.foo.com:22000):(Total: 2s666ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 15.78 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 21.47 MB, 84.36 MB, 87.14 MB, 96.03 MB, 135.01 MB, 245.12 MB, 475.80 MB, 765.63 MB, 1.06 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.20 GB, 4.47 GB, 4.79 GB, 5.08 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.63 GB (6050389924) - PeakReservation: 99.88 MB (104726528) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.75 GB (6178262169) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 2s666ms - ExecTreePrepareTime: 714.863ms KrpcDataStreamSender (dst_id=26):(Total: 1s569ms, non-child: 1s569ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s746ms, non-child: 1s746ms, % non-child: 100.00%) - CodegenTime: 3.425ms - CompileTime: 585.444ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 814.338ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 336.602ms AGGREGATION_NODE (id=15):(Total: 714.861ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 1s390ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 75.392ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 74.382ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 74.880ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 294.908us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 525.794ms, non-child: 50.362us, % non-child: 0.01%) - ConvertRowBatchTime: 34.863us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 2.85 K/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 525.750ms - DataArrivalTimer: 525.744ms SenderSide: - DeserializeRowBatchTime: 165.562ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=13):(Total: 1s340ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 7.304ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 6.462ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 5.751ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.342ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 35.253us, non-child: 35.253us, % non-child: 100.00%) - ConvertRowBatchTime: 17.793us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 31.09 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 8.966us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 41.593us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 298.75K (298751) - BuildTime: 443.841ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 96.13 MB (100798720) - ProbeRows: 118.92M (118919168) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s273ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 316.075ms - BuildRowsPartitioned: 298.75K (298751) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.110ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 62.258ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.113ms - PeakMemoryUsage: 0 - RowsReturned: 298.75K (298751) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.79 MB, 37.67 MB, 40.77 MB, 40.77 MB, 40.77 MB, 40.98 MB, 52.46 MB, 73.25 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 80.99 MB (84926745) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 478.926ms - NumBatchesAccepted: 82 (82) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m18s, non-child: 7s753ms, % non-child: 2.43%) - ConvertRowBatchTime: 2s895ms - PeakMemoryUsage: 0 - RowsReturned: 118.92M (118919168) - RowsReturnedRate: 373.20 K/sec RecvrSide: BytesReceived(16s000ms): 8.66 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.79 MB, 96.30 MB, 248.86 MB, 440.23 MB, 653.88 MB, 877.51 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.66 GB (3925267896) - TotalGetBatchTime: 5m15s - DataArrivalTimer: 5m10s SenderSide: - DeserializeRowBatchTime: 1m52s - NumBatchesAccepted: 5.67K (5672) - NumBatchesDeferred: 27 (27) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 79.670ms - CumulativeAllocationBytes: 96.00 MB (100663296) - CumulativeAllocations: 48 (48) - PeakReservation: 96.00 MB (100663296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 96.00 MB (100663296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b2 (host=vc1532.foo.com:22000):(Total: 1s729ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.65 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 24.59 MB, 101.45 MB, 106.44 MB, 143.13 MB, 155.85 MB, 254.42 MB, 482.82 MB, 770.26 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.20 GB, 4.47 GB, 4.79 GB, 5.09 GB, 5.39 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.82 GB (6253027212) - PeakReservation: 109.88 MB (115212288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.94 GB (6377273257) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s729ms - ExecTreePrepareTime: 221.972ms KrpcDataStreamSender (dst_id=26):(Total: 1s214ms, non-child: 1s214ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s069ms, non-child: 1s069ms, % non-child: 100.00%) - CodegenTime: 3.878ms - CompileTime: 240.134ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 590.698ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 219.405ms AGGREGATION_NODE (id=15):(Total: 221.970ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 339.341ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 2.612ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 1.825ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 405.967us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.068ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s958ms, non-child: 32.497us, % non-child: 0.00%) - ConvertRowBatchTime: 18.890us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 506.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s958ms - DataArrivalTimer: 2s958ms SenderSide: - DeserializeRowBatchTime: 11.927ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 239.853ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 624.314us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 99.861us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 184.989us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 210.370us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 39.034us, non-child: 39.034us, % non-child: 100.00%) - ConvertRowBatchTime: 28.607us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 28.08 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 4.764us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 43.448us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m22s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 309.99K (309994) - BuildTime: 485.724ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 106.13 MB (111284480) - ProbeRows: 122.78M (122784768) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s550ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 333.577ms - BuildRowsPartitioned: 309.99K (309994) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.589ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m21s, non-child: 31.218ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.496ms - PeakMemoryUsage: 0 - RowsReturned: 309.99K (309994) - RowsReturnedRate: 1.18 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3.87 MB, 40.21 MB, 40.90 MB, 40.90 MB, 57.05 MB, 79.42 MB, 82.29 MB, 83.64 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 84.28 MB (88376911) - TotalGetBatchTime: 4m21s - DataArrivalTimer: 4m21s SenderSide: - DeserializeRowBatchTime: 427.898ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m29s, non-child: 6s620ms, % non-child: 2.01%) - ConvertRowBatchTime: 2s983ms - PeakMemoryUsage: 0 - RowsReturned: 122.79M (122785205) - RowsReturnedRate: 372.59 K/sec RecvrSide: BytesReceived(16s000ms): 8.97 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 17.76 MB, 95.14 MB, 246.48 MB, 436.35 MB, 649.32 MB, 872.66 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.77 GB (4051911765) - TotalGetBatchTime: 5m26s - DataArrivalTimer: 5m22s SenderSide: - DeserializeRowBatchTime: 1m36s - NumBatchesAccepted: 5.86K (5855) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 92.561ms - CumulativeAllocationBytes: 106.00 MB (111149056) - CumulativeAllocations: 53 (53) - PeakReservation: 106.00 MB (111149056) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 106.00 MB (111149056) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b6 (host=vc1524.foo.com:22000):(Total: 1s728ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.61 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 20.59 MB, 92.51 MB, 101.64 MB, 101.87 MB, 126.09 MB, 245.39 MB, 472.05 MB, 759.34 MB, 1.05 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.08 GB, 5.38 GB, 5.60 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.80 GB (6232580220) - PeakReservation: 97.88 MB (102629376) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.92 GB (6353870268) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m49s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s728ms - ExecTreePrepareTime: 133.098ms KrpcDataStreamSender (dst_id=26):(Total: 1s169ms, non-child: 1s169ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s548ms, non-child: 1s548ms, % non-child: 100.00%) - CodegenTime: 6.502ms - CompileTime: 398.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 799.879ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 339.467ms AGGREGATION_NODE (id=15):(Total: 133.097ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 265.720ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 28.628ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 27.230ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.940ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 453.356us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s286ms, non-child: 72.578us, % non-child: 0.00%) - ConvertRowBatchTime: 49.144us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 656.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s286ms - DataArrivalTimer: 2s286ms SenderSide: - DeserializeRowBatchTime: 15.182ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 264.935ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 11.213ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 10.596ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 104.672us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 10.870ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 37.194us, non-child: 37.194us, % non-child: 100.00%) - ConvertRowBatchTime: 28.663us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 29.47 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 4.043us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 40.879us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 288.57K (288574) - BuildTime: 1s099ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 94.13 MB (98701568) - ProbeRows: 122.68M (122680320) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s040ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 944.638ms - BuildRowsPartitioned: 288.57K (288574) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 93.124ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m21s, non-child: 68.151ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.177ms - PeakMemoryUsage: 0 - RowsReturned: 288.57K (288574) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 142.46 KB, 33.97 MB, 41.04 MB, 41.04 MB, 41.04 MB, 41.04 MB, 47.65 MB, 67.95 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 78.78 MB (82608746) - TotalGetBatchTime: 4m21s - DataArrivalTimer: 4m21s SenderSide: - DeserializeRowBatchTime: 536.484ms - NumBatchesAccepted: 74 (74) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m28s, non-child: 7s003ms, % non-child: 2.13%) - ConvertRowBatchTime: 2s963ms - PeakMemoryUsage: 0 - RowsReturned: 122.68M (122680350) - RowsReturnedRate: 373.84 K/sec RecvrSide: BytesReceived(16s000ms): 9.16 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.71 MB, 96.91 MB, 247.18 MB, 437.05 MB, 648.81 MB, 873.10 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.77 GB (4048451550) - TotalGetBatchTime: 5m25s - DataArrivalTimer: 5m21s SenderSide: - DeserializeRowBatchTime: 2m7s - NumBatchesAccepted: 5.85K (5850) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 234.632ms - CumulativeAllocationBytes: 94.00 MB (98566144) - CumulativeAllocations: 47 (47) - PeakReservation: 94.00 MB (98566144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 94.00 MB (98566144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000bf (host=vc1523.foo.com:22000):(Total: 1s693ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.88 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 19.14 MB, 26.34 MB, 100.80 MB, 103.89 MB, 109.34 MB, 143.14 MB, 275.31 MB, 506.07 MB, 801.95 MB, 1.10 GB, 1.43 GB, 1.74 GB, 1.98 GB, 2.20 GB, 2.44 GB, 2.69 GB, 2.95 GB, 3.18 GB, 3.43 GB, 3.68 GB, 3.94 GB, 4.23 GB, 4.51 GB, 4.82 GB, 5.12 GB, 5.42 GB, 5.64 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.88 GB (6311747468) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.98 GB (6417317062) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s693ms - ExecTreePrepareTime: 224.173ms KrpcDataStreamSender (dst_id=26):(Total: 889.278ms, non-child: 889.278ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 2s003ms, non-child: 2s003ms, % non-child: 100.00%) - CodegenTime: 3.114ms - CompileTime: 452.097ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 1s035ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 480.468ms AGGREGATION_NODE (id=15):(Total: 224.172ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 332.517ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 37.319ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 35.814ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 35.756ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.363ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 1s096ms, non-child: 50.735us, % non-child: 0.00%) - ConvertRowBatchTime: 32.570us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 1.37 K/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 1s096ms - DataArrivalTimer: 1s096ms SenderSide: - DeserializeRowBatchTime: 137.869ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=13):(Total: 260.692ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 78.816ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 77.784ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 78.063ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 413.722us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 155.569ms, non-child: 48.558us, % non-child: 0.03%) - ConvertRowBatchTime: 30.335us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 7.04 K/sec RecvrSide: BytesReceived(500.000ms): 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 155.529ms - DataArrivalTimer: 155.521ms SenderSide: - DeserializeRowBatchTime: 39.390us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 297.52K (297516) - BuildTime: 559.161ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 124.04M (124043264) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s008ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 441.565ms - BuildRowsPartitioned: 297.52K (297516) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.567ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m24s, non-child: 79.283ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.580ms - PeakMemoryUsage: 0 - RowsReturned: 297.52K (297516) - RowsReturnedRate: 1.13 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 4.98 MB, 39.39 MB, 40.98 MB, 40.98 MB, 40.98 MB, 42.22 MB, 53.44 MB, 72.14 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 81.07 MB (85008681) - TotalGetBatchTime: 4m24s - DataArrivalTimer: 4m24s SenderSide: - DeserializeRowBatchTime: 823.543ms - NumBatchesAccepted: 83 (83) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m31s, non-child: 9s278ms, % non-child: 2.79%) - ConvertRowBatchTime: 3s019ms - PeakMemoryUsage: 0 - RowsReturned: 124.04M (124043465) - RowsReturnedRate: 373.66 K/sec RecvrSide: BytesReceived(16s000ms): 9.43 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.87 MB, 111.64 MB, 264.14 MB, 459.41 MB, 673.43 MB, 898.11 MB, 1.08 GB, 1.24 GB, 1.39 GB, 1.54 GB, 1.71 GB, 1.88 GB, 2.03 GB, 2.20 GB, 2.36 GB, 2.54 GB, 2.72 GB, 2.91 GB, 3.11 GB, 3.31 GB, 3.51 GB, 3.65 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.81 GB (4093434345) - TotalGetBatchTime: 5m28s - DataArrivalTimer: 5m22s SenderSide: - DeserializeRowBatchTime: 2m6s - NumBatchesAccepted: 5.92K (5915) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 1 (1) Buffer pool: - AllocTime: 161.449ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b0 (host=vc1539.foo.com:22000):(Total: 1s309ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.72 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 18.64 MB, 22.86 MB, 96.58 MB, 100.14 MB, 108.89 MB, 144.95 MB, 264.18 MB, 496.14 MB, 790.86 MB, 1.10 GB, 1.43 GB, 1.74 GB, 1.98 GB, 2.21 GB, 2.44 GB, 2.70 GB, 2.95 GB, 3.19 GB, 3.44 GB, 3.68 GB, 3.94 GB, 4.23 GB, 4.51 GB, 4.82 GB, 5.12 GB, 5.42 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.53 GB (5940289636) - PeakReservation: 103.88 MB (108920832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.65 GB (6070959513) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m31s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s309ms - ExecTreePrepareTime: 97.795ms KrpcDataStreamSender (dst_id=26):(Total: 922.977ms, non-child: 922.977ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s450ms, non-child: 1s450ms, % non-child: 100.00%) - CodegenTime: 5.439ms - CompileTime: 445.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 755.052ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 248.728ms AGGREGATION_NODE (id=15):(Total: 97.794ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 195.221ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 8.853ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.682ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.227ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 330.857us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 641.736ms, non-child: 78.600us, % non-child: 0.01%) - ConvertRowBatchTime: 55.391us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 2.34 K/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 641.669ms - DataArrivalTimer: 641.659ms SenderSide: - DeserializeRowBatchTime: 22.333ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 175.905ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 28.022ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 27.219ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.404ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 376.738us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 45.729us, non-child: 45.729us, % non-child: 100.00%) - ConvertRowBatchTime: 29.529us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 23.97 M/sec RecvrSide: BytesReceived(500.000ms): 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 8.419us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 49.471us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 297.80K (297804) - BuildTime: 426.051ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 100.13 MB (104993024) - ProbeRows: 116.70M (116703232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s873ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 289.240ms - BuildRowsPartitioned: 297.80K (297804) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.816ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 19.620ms, % non-child: 0.01%) - ConvertRowBatchTime: 9.924ms - PeakMemoryUsage: 0 - RowsReturned: 297.80K (297804) - RowsReturnedRate: 1.13 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.63 MB, 38.78 MB, 41.07 MB, 41.07 MB, 41.07 MB, 41.90 MB, 56.56 MB, 74.06 MB - FirstBatchArrivalWaitTime: 3m24s - TotalBytesReceived: 81.25 MB (85191795) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 942.774ms - NumBatchesAccepted: 81 (81) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m10s, non-child: 6s656ms, % non-child: 2.14%) - ConvertRowBatchTime: 2s820ms - PeakMemoryUsage: 0 - RowsReturned: 116.70M (116703615) - RowsReturnedRate: 375.35 K/sec RecvrSide: BytesReceived(16s000ms): 9.55 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 19.68 MB, 106.63 MB, 260.43 MB, 455.88 MB, 679.33 MB, 903.64 MB, 1.09 GB, 1.24 GB, 1.39 GB, 1.55 GB, 1.71 GB, 1.88 GB, 2.04 GB, 2.20 GB, 2.37 GB, 2.54 GB, 2.73 GB, 2.91 GB, 3.12 GB, 3.32 GB, 3.51 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.59 GB (3851219295) - TotalGetBatchTime: 5m8s - DataArrivalTimer: 5m4s SenderSide: - DeserializeRowBatchTime: 1m59s - NumBatchesAccepted: 5.57K (5565) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 59.042ms - CumulativeAllocationBytes: 100.00 MB (104857600) - CumulativeAllocations: 50 (50) - PeakReservation: 100.00 MB (104857600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 100.00 MB (104857600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a9 (host=vc1504.foo.com:22000):(Total: 1s133ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.19 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 25.97 MB, 96.95 MB, 104.24 MB, 138.52 MB, 153.47 MB, 258.55 MB, 486.82 MB, 776.60 MB, 1.07 GB, 1.40 GB, 1.72 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.65 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.49 GB (5893103524) - PeakReservation: 109.88 MB (115212288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.60 GB (6013320337) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m28s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s133ms - ExecTreePrepareTime: 396.111ms KrpcDataStreamSender (dst_id=26):(Total: 428.717ms, non-child: 428.717ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s321ms, non-child: 1s321ms, % non-child: 100.00%) - CodegenTime: 4.724ms - CompileTime: 346.422ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 688.650ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 248.772ms AGGREGATION_NODE (id=15):(Total: 396.109ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 692.255ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 907.334us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 12.137us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 322.472us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 341.398us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s636ms, non-child: 54.499us, % non-child: 0.00%) - ConvertRowBatchTime: 39.972us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 568.00 /sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s636ms - DataArrivalTimer: 2s636ms SenderSide: - DeserializeRowBatchTime: 28.455ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=13):(Total: 538.839ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 611.283us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.728us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 154.835us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 225.533us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 41.042us, non-child: 41.042us, % non-child: 100.00%) - ConvertRowBatchTime: 29.136us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 26.70 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 5.198us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 50.363us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m19s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 310.78K (310783) - BuildTime: 606.717ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 106.13 MB (111284480) - ProbeRows: 115.59M (115591168) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s034ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 380.057ms - BuildRowsPartitioned: 310.78K (310783) - HashBuckets: 655.36K (655360) - HashCollisions: 0 (0) - HashTablesBuildTime: 97.915ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m18s, non-child: 46.357ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.484ms - PeakMemoryUsage: 0 - RowsReturned: 310.78K (310783) - RowsReturnedRate: 1.20 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.01 MB, 40.64 MB, 40.85 MB, 40.85 MB, 58.07 MB, 78.66 MB, 82.64 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 84.36 MB (88460717) - TotalGetBatchTime: 4m18s - DataArrivalTimer: 4m18s SenderSide: - DeserializeRowBatchTime: 466.160ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m10s, non-child: 8s830ms, % non-child: 2.84%) - ConvertRowBatchTime: 2s789ms - PeakMemoryUsage: 0 - RowsReturned: 115.59M (115592152) - RowsReturnedRate: 371.87 K/sec RecvrSide: BytesReceived(16s000ms): 9.30 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 21.18 MB, 97.84 MB, 248.79 MB, 440.04 MB, 652.31 MB, 875.49 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.71 GB, 2.89 GB, 3.09 GB, 3.29 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.55 GB (3814541016) - TotalGetBatchTime: 5m7s - DataArrivalTimer: 5m2s SenderSide: - DeserializeRowBatchTime: 1m57s - NumBatchesAccepted: 5.51K (5512) - NumBatchesDeferred: 28 (28) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 181.424ms - CumulativeAllocationBytes: 106.00 MB (111149056) - CumulativeAllocations: 53 (53) - PeakReservation: 106.00 MB (111149056) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 106.00 MB (111149056) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000bc (host=vc1537.foo.com:22000):(Total: 1s113ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.40 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 24.14 MB, 96.91 MB, 99.90 MB, 113.96 MB, 148.87 MB, 251.12 MB, 485.96 MB, 777.62 MB, 1.08 GB, 1.41 GB, 1.72 GB, 1.96 GB, 2.19 GB, 2.43 GB, 2.67 GB, 2.93 GB, 3.17 GB, 3.42 GB, 3.66 GB, 3.93 GB, 4.21 GB, 4.49 GB, 4.80 GB, 5.10 GB, 5.40 GB, 5.63 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.72 GB (6147129548) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.83 GB (6264686281) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s113ms - ExecTreePrepareTime: 131.448ms KrpcDataStreamSender (dst_id=26):(Total: 617.599ms, non-child: 617.599ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s623ms, non-child: 1s623ms, % non-child: 100.00%) - CodegenTime: 7.510ms - CompileTime: 430.967ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 177 (177) - NumInstructions: 8.54K (8537) - OptimizationTime: 907.467ms - PeakMemoryUsage: 4.17 MB (4370944) - PrepareTime: 268.929ms AGGREGATION_NODE (id=15):(Total: 131.446ms, non-child: 91.568ms, % non-child: 69.66%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 39.877ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 196.742ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 9.022ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 196.094ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 411.566us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 1s317ms, non-child: 59.695us, % non-child: 0.00%) - ConvertRowBatchTime: 39.549us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 1s317ms - DataArrivalTimer: 1s317ms SenderSide: - DeserializeRowBatchTime: 335.688us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 39.164ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 116.787ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 48.594ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.524ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 80.932ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 994.039ms, non-child: 37.345us, % non-child: 0.00%) - ConvertRowBatchTime: 18.796us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 994.011ms - DataArrivalTimer: 994.003ms SenderSide: - DeserializeRowBatchTime: 55.665us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 303.41K (303407) - BuildTime: 572.400ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 120.75M (120745984) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s680ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 498.173ms - BuildRowsPartitioned: 303.41K (303407) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.126ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 51.481ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.517ms - PeakMemoryUsage: 0 - RowsReturned: 303.41K (303407) - RowsReturnedRate: 1.15 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.63 MB, 39.35 MB, 41.02 MB, 41.02 MB, 42.05 MB, 53.12 MB, 69.45 MB, 79.44 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 82.69 MB (86711081) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 1s180ms - NumBatchesAccepted: 105 (105) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m22s, non-child: 8s275ms, % non-child: 2.57%) - ConvertRowBatchTime: 2s946ms - PeakMemoryUsage: 0 - RowsReturned: 120.75M (120745984) - RowsReturnedRate: 374.57 K/sec RecvrSide: BytesReceived(16s000ms): 9.22 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 14.91 MB, 95.92 MB, 251.23 MB, 444.27 MB, 662.85 MB, 886.75 MB, 1.07 GB, 1.23 GB, 1.38 GB, 1.53 GB, 1.70 GB, 1.87 GB, 2.02 GB, 2.19 GB, 2.35 GB, 2.53 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.30 GB, 3.50 GB, 3.65 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.71 GB (3985475637) - TotalGetBatchTime: 5m19s - DataArrivalTimer: 5m14s SenderSide: - DeserializeRowBatchTime: 2m21s - NumBatchesAccepted: 5.76K (5759) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 255.801ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a6 (host=vc1515.foo.com:22000):(Total: 1s012ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.07 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 23.89 MB, 92.47 MB, 98.91 MB, 128.95 MB, 150.13 MB, 250.37 MB, 476.60 MB, 766.63 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.42 GB, 2.66 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.80 GB, 5.09 GB, 5.40 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.61 GB (6018408212) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.70 GB (6122993297) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m37s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1s012ms - ExecTreePrepareTime: 124.556ms KrpcDataStreamSender (dst_id=26):(Total: 381.736ms, non-child: 381.736ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s637ms, non-child: 1s637ms, % non-child: 100.00%) - CodegenTime: 4.220ms - CompileTime: 527.749ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 765.498ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 330.455ms AGGREGATION_NODE (id=15):(Total: 124.554ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 186.393ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 17.394ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 16.204ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 16.667ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 380.721us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s012ms, non-child: 82.588us, % non-child: 0.00%) - ConvertRowBatchTime: 62.304us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 497.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s012ms - DataArrivalTimer: 3s012ms SenderSide: - DeserializeRowBatchTime: 393.332us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 185.714ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 106.753ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 105.760ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 80.591ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 25.869ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 1s020ms, non-child: 50.212us, % non-child: 0.00%) - ConvertRowBatchTime: 33.063us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.07 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 1s020ms - DataArrivalTimer: 1s020ms SenderSide: - DeserializeRowBatchTime: 25.300us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m17s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 308.45K (308449) - BuildTime: 598.376ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 118.15M (118150144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s975ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 464.346ms - BuildRowsPartitioned: 308.45K (308449) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.637ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m16s, non-child: 129.251ms, % non-child: 0.05%) - ConvertRowBatchTime: 10.607ms - PeakMemoryUsage: 0 - RowsReturned: 308.45K (308449) - RowsReturnedRate: 1.20 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.94 MB, 38.09 MB, 40.99 MB, 40.99 MB, 51.59 MB, 74.37 MB, 81.01 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 84.09 MB (88175575) - TotalGetBatchTime: 4m16s - DataArrivalTimer: 4m16s SenderSide: - DeserializeRowBatchTime: 856.597ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m19s, non-child: 8s125ms, % non-child: 2.54%) - ConvertRowBatchTime: 2s863ms - PeakMemoryUsage: 0 - RowsReturned: 118.15M (118150614) - RowsReturnedRate: 369.30 K/sec RecvrSide: BytesReceived(16s000ms): 9.10 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 22.21 MB, 95.10 MB, 244.85 MB, 436.27 MB, 652.56 MB, 875.92 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.63 GB (3898970262) - TotalGetBatchTime: 5m17s - DataArrivalTimer: 5m11s SenderSide: - DeserializeRowBatchTime: 2m18s - NumBatchesAccepted: 5.63K (5634) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 212.142ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000bb (host=vc1536.foo.com:22000):(Total: 953.289ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.07 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 23.86 MB, 97.23 MB, 101.55 MB, 109.56 MB, 150.91 MB, 265.62 MB, 496.92 MB, 785.80 MB, 1.09 GB, 1.42 GB, 1.73 GB, 1.97 GB, 2.19 GB, 2.43 GB, 2.68 GB, 2.94 GB, 3.17 GB, 3.42 GB, 3.67 GB, 3.93 GB, 4.22 GB, 4.49 GB, 4.80 GB, 5.11 GB, 5.41 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.65 GB (6061932676) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.75 GB (6172297338) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 953.218ms - ExecTreePrepareTime: 163.782ms KrpcDataStreamSender (dst_id=26):(Total: 426.991ms, non-child: 426.991ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s577ms, non-child: 1s577ms, % non-child: 100.00%) - CodegenTime: 3.032ms - CompileTime: 401.308ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 177 (177) - NumInstructions: 8.54K (8537) - OptimizationTime: 877.009ms - PeakMemoryUsage: 4.17 MB (4370944) - PrepareTime: 283.244ms AGGREGATION_NODE (id=15):(Total: 163.780ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 309.483ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 13.522ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 12.098ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.557ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.618ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s212ms, non-child: 86.307us, % non-child: 0.00%) - ConvertRowBatchTime: 66.508us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 466.00 /sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s211ms - DataArrivalTimer: 3s211ms SenderSide: - DeserializeRowBatchTime: 1.814ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 191.428ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 86.114ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 84.830ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 85.205ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 485.464us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 48.159us, non-child: 48.159us, % non-child: 100.00%) - ConvertRowBatchTime: 30.501us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 22.76 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 7.302us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 11.332ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 302.39K (302392) - BuildTime: 411.090ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 119.01M (119010304) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s597ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 330.413ms - BuildRowsPartitioned: 302.39K (302392) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.250ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 74.231ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.283ms - PeakMemoryUsage: 0 - RowsReturned: 302.39K (302392) - RowsReturnedRate: 1.15 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.58 MB, 38.31 MB, 40.57 MB, 40.57 MB, 41.81 MB, 49.64 MB, 64.54 MB, 77.03 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 81.72 MB (85689713) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 1s034ms - NumBatchesAccepted: 101 (101) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m16s, non-child: 7s170ms, % non-child: 2.27%) - ConvertRowBatchTime: 2s878ms - PeakMemoryUsage: 0 - RowsReturned: 119.01M (119010425) - RowsReturnedRate: 376.54 K/sec RecvrSide: BytesReceived(16s000ms): 9.14 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.52 MB, 103.99 MB, 256.94 MB, 447.59 MB, 663.35 MB, 887.64 MB, 1.07 GB, 1.23 GB, 1.38 GB, 1.53 GB, 1.70 GB, 1.87 GB, 2.03 GB, 2.19 GB, 2.35 GB, 2.52 GB, 2.72 GB, 2.90 GB, 3.10 GB, 3.30 GB, 3.50 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.66 GB (3927344025) - TotalGetBatchTime: 5m13s - DataArrivalTimer: 5m8s SenderSide: - DeserializeRowBatchTime: 2m4s - NumBatchesAccepted: 5.67K (5675) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 85.887ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ae (host=vc1516.foo.com:22000):(Total: 639.150ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.92 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 22.69 MB, 96.59 MB, 102.39 MB, 106.17 MB, 139.31 MB, 250.59 MB, 480.29 MB, 768.62 MB, 1.06 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.16 GB, 3.40 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.50 GB (5901492036) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.59 GB (6002962309) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 639.065ms - ExecTreePrepareTime: 54.132ms KrpcDataStreamSender (dst_id=26):(Total: 275.135ms, non-child: 275.135ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s449ms, non-child: 1s449ms, % non-child: 100.00%) - CodegenTime: 2.904ms - CompileTime: 451.668ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 795.786ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 182.323ms AGGREGATION_NODE (id=15):(Total: 54.130ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 87.063ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 49.612ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 48.160ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 44.258ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 5.115ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s787ms, non-child: 70.342us, % non-child: 0.00%) - ConvertRowBatchTime: 50.604us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 396.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s787ms - DataArrivalTimer: 3s787ms SenderSide: - DeserializeRowBatchTime: 13.829ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 82.485ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 16.337ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 15.419ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 15.628ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 352.566us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 819.759ms, non-child: 76.244us, % non-child: 0.01%) - ConvertRowBatchTime: 50.256us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.34 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 819.690ms - DataArrivalTimer: 819.684ms SenderSide: - DeserializeRowBatchTime: 30.600us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m20s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 295.46K (295458) - BuildTime: 421.571ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 115.82M (115822592) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s330ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 335.338ms - BuildRowsPartitioned: 295.46K (295458) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.019ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m19s, non-child: 61.501ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.487ms - PeakMemoryUsage: 0 - RowsReturned: 295.46K (295458) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 709.61 KB, 36.51 MB, 41.01 MB, 41.01 MB, 41.01 MB, 41.01 MB, 52.52 MB, 72.21 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 80.58 MB (84498907) - TotalGetBatchTime: 4m19s - DataArrivalTimer: 4m19s SenderSide: - DeserializeRowBatchTime: 593.965ms - NumBatchesAccepted: 76 (76) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m8s, non-child: 7s693ms, % non-child: 2.49%) - ConvertRowBatchTime: 2s841ms - PeakMemoryUsage: 0 - RowsReturned: 115.82M (115822833) - RowsReturnedRate: 375.49 K/sec RecvrSide: BytesReceived(16s000ms): 8.83 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 18.58 MB, 95.04 MB, 246.79 MB, 437.16 MB, 649.42 MB, 874.60 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.09 GB, 3.29 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.56 GB (3822153489) - TotalGetBatchTime: 5m5s - DataArrivalTimer: 5m SenderSide: - DeserializeRowBatchTime: 1m59s - NumBatchesAccepted: 5.52K (5523) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 94.420ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c9 (host=vc1535.foo.com:22000):(Total: 530.156ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.48 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.93 MB, 93.71 MB, 98.77 MB, 111.50 MB, 144.00 MB, 250.91 MB, 479.26 MB, 764.48 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.40 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.85 GB (6278717372) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6387686530) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 530.090ms - ExecTreePrepareTime: 44.878ms KrpcDataStreamSender (dst_id=26):(Total: 229.579ms, non-child: 229.579ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s423ms, non-child: 1s423ms, % non-child: 100.00%) - CodegenTime: 7.315ms - CompileTime: 476.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 745.249ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 190.539ms AGGREGATION_NODE (id=15):(Total: 44.876ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 74.698ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 2.458ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 1.354ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1.790ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 434.906us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 56.310ms, non-child: 64.563us, % non-child: 0.11%) - ConvertRowBatchTime: 48.431us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 26.64 K/sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 56.253ms - DataArrivalTimer: 56.246ms SenderSide: - DeserializeRowBatchTime: 20.782ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 48.132ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 3.862ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 3.204ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3.369ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 258.182us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 1s732ms, non-child: 48.661us, % non-child: 0.00%) - ConvertRowBatchTime: 32.859us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 632.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 1s732ms - DataArrivalTimer: 1s732ms SenderSide: - DeserializeRowBatchTime: 49.353us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m31s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 302.85K (302845) - BuildTime: 679.599ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 123.33M (123329536) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s039ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 403.888ms - BuildRowsPartitioned: 302.85K (302845) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.925ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m30s, non-child: 194.422ms, % non-child: 0.07%) - ConvertRowBatchTime: 10.308ms - PeakMemoryUsage: 0 - RowsReturned: 302.85K (302845) - RowsReturnedRate: 1.12 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 71.57 KB, 34.77 MB, 41.25 MB, 41.25 MB, 41.60 MB, 52.67 MB, 65.77 MB, 76.79 MB, 81.10 MB - FirstBatchArrivalWaitTime: 3m25s - TotalBytesReceived: 83.02 MB (87052431) - TotalGetBatchTime: 4m30s - DataArrivalTimer: 4m29s SenderSide: - DeserializeRowBatchTime: 1s119ms - NumBatchesAccepted: 103 (103) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m25s, non-child: 7s806ms, % non-child: 2.40%) - ConvertRowBatchTime: 3s034ms - PeakMemoryUsage: 0 - RowsReturned: 123.33M (123330451) - RowsReturnedRate: 378.76 K/sec RecvrSide: BytesReceived(16s000ms): 9.05 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 92.34 MB, 245.39 MB, 433.73 MB, 649.40 MB, 873.39 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.89 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.79 GB (4070596926) - TotalGetBatchTime: 5m22s - DataArrivalTimer: 5m17s SenderSide: - DeserializeRowBatchTime: 2m23s - NumBatchesAccepted: 5.88K (5882) - NumBatchesDeferred: 45 (45) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 147.607ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a7 (host=vc1538.foo.com:22000):(Total: 481.630ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.91 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 22.93 MB, 96.58 MB, 107.23 MB, 141.77 MB, 155.23 MB, 250.13 MB, 475.26 MB, 760.51 MB, 1.05 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.78 GB, 5.08 GB, 5.38 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.86 GB (6287105980) - PeakReservation: 111.88 MB (117309440) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.98 GB (6416452754) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 481.583ms - ExecTreePrepareTime: 53.693ms KrpcDataStreamSender (dst_id=26):(Total: 140.890ms, non-child: 140.890ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s336ms, non-child: 1s336ms, % non-child: 100.00%) - CodegenTime: 2.885ms - CompileTime: 434.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 711.955ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 187.600ms AGGREGATION_NODE (id=15):(Total: 53.692ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 83.738ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 44.532ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 43.541ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.943ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 289.566us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s163ms, non-child: 93.020us, % non-child: 0.00%) - ConvertRowBatchTime: 66.667us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 360.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s163ms - DataArrivalTimer: 4s162ms SenderSide: - DeserializeRowBatchTime: 8.344ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 79.664ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 15.732ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 15.128ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 15.319ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 242.309us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 29.003us, non-child: 29.003us, % non-child: 100.00%) - ConvertRowBatchTime: 16.782us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 37.79 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 4.409us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 42.345us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m18s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 312.81K (312809) - BuildTime: 552.736ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 108.13 MB (113381632) - ProbeRows: 123.44M (123435008) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s013ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 450.814ms - BuildRowsPartitioned: 312.81K (312809) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.244ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m17s, non-child: 96.391ms, % non-child: 0.04%) - ConvertRowBatchTime: 11.185ms - PeakMemoryUsage: 0 - RowsReturned: 312.81K (312809) - RowsReturnedRate: 1.21 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.45 MB, 39.39 MB, 40.91 MB, 40.98 MB, 60.58 MB, 80.82 MB, 82.87 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 85.09 MB (89223697) - TotalGetBatchTime: 4m17s - DataArrivalTimer: 4m17s SenderSide: - DeserializeRowBatchTime: 738.997ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m36s, non-child: 7s691ms, % non-child: 2.29%) - ConvertRowBatchTime: 3s010ms - PeakMemoryUsage: 0 - RowsReturned: 123.44M (123435306) - RowsReturnedRate: 367.26 K/sec RecvrSide: BytesReceived(16s000ms): 8.83 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 21.28 MB, 91.06 MB, 240.67 MB, 428.93 MB, 637.87 MB, 863.24 MB, 1.05 GB, 1.21 GB, 1.36 GB, 1.52 GB, 1.68 GB, 1.85 GB, 2.01 GB, 2.17 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB, 3.48 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.79 GB (4073365098) - TotalGetBatchTime: 5m33s - DataArrivalTimer: 5m28s SenderSide: - DeserializeRowBatchTime: 1m56s - NumBatchesAccepted: 5.89K (5886) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 199.010ms - CumulativeAllocationBytes: 108.00 MB (113246208) - CumulativeAllocations: 54 (54) - PeakReservation: 108.00 MB (113246208) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 108.00 MB (113246208) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000aa (host=vc1527.foo.com:22000):(Total: 474.045ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 16.80 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 18.89 MB, 20.17 MB, 95.82 MB, 99.39 MB, 109.05 MB, 149.41 MB, 252.72 MB, 480.75 MB, 772.51 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.40 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.39 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.87 GB (6300475540) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.96 GB (6404239140) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 473.986ms - ExecTreePrepareTime: 21.389ms KrpcDataStreamSender (dst_id=26):(Total: 200.196ms, non-child: 200.196ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s779ms, non-child: 1s779ms, % non-child: 100.00%) - CodegenTime: 3.673ms - CompileTime: 861.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 695.111ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 220.774ms AGGREGATION_NODE (id=15):(Total: 21.385ms, non-child: 9.399ms, % non-child: 43.95%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 11.985ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 906.050ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 904.678ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 900.032ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 5.607ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s480ms, non-child: 85.143us, % non-child: 0.00%) - ConvertRowBatchTime: 62.896us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 604.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s480ms - DataArrivalTimer: 2s480ms SenderSide: - DeserializeRowBatchTime: 2.384ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 7.291ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 17.269ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 16.352ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 16.537ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 454.475us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 49.597us, non-child: 49.597us, % non-child: 100.00%) - ConvertRowBatchTime: 34.991us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 22.10 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.101us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 39.434us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m19s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 299.12K (299119) - BuildTime: 635.902ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 123.85M (123853824) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s353ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 517.685ms - BuildRowsPartitioned: 299.12K (299119) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 61.695ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m18s, non-child: 93.682ms, % non-child: 0.04%) - ConvertRowBatchTime: 9.991ms - PeakMemoryUsage: 0 - RowsReturned: 299.12K (299119) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 282.86 KB, 37.40 MB, 40.85 MB, 40.85 MB, 40.85 MB, 41.40 MB, 59.02 MB - FirstBatchArrivalWaitTime: 3m23s - TotalBytesReceived: 81.23 MB (85170980) - TotalGetBatchTime: 4m18s - DataArrivalTimer: 4m18s SenderSide: - DeserializeRowBatchTime: 1s222ms - NumBatchesAccepted: 86 (86) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m36s, non-child: 7s520ms, % non-child: 2.23%) - ConvertRowBatchTime: 3s023ms - PeakMemoryUsage: 0 - RowsReturned: 123.85M (123854726) - RowsReturnedRate: 368.00 K/sec RecvrSide: BytesReceived(16s000ms): 8.87 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 20.65 MB, 98.38 MB, 249.47 MB, 442.13 MB, 654.62 MB, 880.50 MB, 1.06 GB, 1.23 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.87 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.81 GB (4087898001) - TotalGetBatchTime: 5m33s - DataArrivalTimer: 5m29s SenderSide: - DeserializeRowBatchTime: 2m19s - NumBatchesAccepted: 5.91K (5907) - NumBatchesDeferred: 27 (27) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 256.721ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ad (host=vc1511.foo.com:22000):(Total: 470.712ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.05 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 21.38 MB, 87.75 MB, 94.64 MB, 98.55 MB, 133.62 MB, 241.76 MB, 468.61 MB, 752.75 MB, 1.05 GB, 1.38 GB, 1.69 GB, 1.94 GB, 2.16 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.14 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.07 GB, 5.38 GB, 5.60 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.85 GB (6276620220) - PeakReservation: 99.88 MB (104726528) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.96 GB (6397539451) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 470.641ms - ExecTreePrepareTime: 20.517ms KrpcDataStreamSender (dst_id=26):(Total: 190.201ms, non-child: 190.201ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s443ms, non-child: 1s443ms, % non-child: 100.00%) - CodegenTime: 3.480ms - CompileTime: 466.924ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 798.072ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 175.416ms AGGREGATION_NODE (id=15):(Total: 20.515ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 37.933ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 22.143ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 21.168ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.566ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 335.402us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s856ms, non-child: 69.118us, % non-child: 0.00%) - ConvertRowBatchTime: 46.937us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 388.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s856ms - DataArrivalTimer: 3s856ms SenderSide: - DeserializeRowBatchTime: 322.717us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 7.800ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 53.575ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 52.906ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 53.087ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 294.546us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 995.419ms, non-child: 37.147us, % non-child: 0.00%) - ConvertRowBatchTime: 17.977us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.10 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 995.392ms - DataArrivalTimer: 995.383ms SenderSide: - DeserializeRowBatchTime: 44.495us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m20s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 296.80K (296801) - BuildTime: 650.979ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 96.13 MB (100798720) - ProbeRows: 123.46M (123455488) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 19s163ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 554.862ms - BuildRowsPartitioned: 296.80K (296801) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.699ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m19s, non-child: 13.294ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.209ms - PeakMemoryUsage: 0 - RowsReturned: 296.80K (296801) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 354.07 KB, 34.77 MB, 40.92 MB, 40.92 MB, 40.92 MB, 40.92 MB, 51.73 MB, 73.03 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 80.68 MB (84600746) - TotalGetBatchTime: 4m19s - DataArrivalTimer: 4m19s SenderSide: - DeserializeRowBatchTime: 943.012ms - NumBatchesAccepted: 77 (77) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m32s, non-child: 7s873ms, % non-child: 2.36%) - ConvertRowBatchTime: 2s986ms - PeakMemoryUsage: 0 - RowsReturned: 123.46M (123456277) - RowsReturnedRate: 370.78 K/sec RecvrSide: BytesReceived(16s000ms): 8.91 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 17.78 MB, 93.16 MB, 243.41 MB, 431.73 MB, 644.35 MB, 869.80 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.68 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.79 GB (4074749184) - TotalGetBatchTime: 5m29s - DataArrivalTimer: 5m25s SenderSide: - DeserializeRowBatchTime: 2m9s - NumBatchesAccepted: 5.89K (5888) - NumBatchesDeferred: 28 (28) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 77.217ms - CumulativeAllocationBytes: 96.00 MB (100663296) - CumulativeAllocations: 48 (48) - PeakReservation: 96.00 MB (100663296) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 96.00 MB (100663296) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000af (host=vc1513.foo.com:22000):(Total: 433.370ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.73 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.65 MB, 95.15 MB, 99.89 MB, 106.29 MB, 138.08 MB, 247.91 MB, 475.52 MB, 767.54 MB, 1.06 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.16 GB, 3.40 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.47 GB, 4.79 GB, 5.09 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.61 GB (6018670716) - PeakReservation: 103.88 MB (108920832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.72 GB (6138939426) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 433.305ms - ExecTreePrepareTime: 12.186ms KrpcDataStreamSender (dst_id=26):(Total: 140.571ms, non-child: 140.571ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s311ms, non-child: 1s311ms, % non-child: 100.00%) - CodegenTime: 3.866ms - CompileTime: 376.465ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 742.357ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 184.874ms AGGREGATION_NODE (id=15):(Total: 12.185ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 23.865ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 91.481ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 89.912ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 69.911ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.227ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s034ms, non-child: 92.045us, % non-child: 0.00%) - ConvertRowBatchTime: 69.380us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 371.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s033ms - DataArrivalTimer: 4s033ms SenderSide: - DeserializeRowBatchTime: 16.033ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 20.072ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 35.121ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 34.284ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 34.459ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 398.419us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 59.254us, non-child: 59.254us, % non-child: 100.00%) - ConvertRowBatchTime: 32.703us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 18.50 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.663us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 26.153us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m21s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 297.66K (297656) - BuildTime: 626.401ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 100.13 MB (104993024) - ProbeRows: 118.28M (118276096) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s290ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 390.412ms - BuildRowsPartitioned: 297.66K (297656) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.291ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m20s, non-child: 82.310ms, % non-child: 0.03%) - ConvertRowBatchTime: 9.443ms - PeakMemoryUsage: 0 - RowsReturned: 297.66K (297656) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 71.25 KB, 35.12 MB, 41.10 MB, 41.10 MB, 41.10 MB, 42.34 MB, 56.41 MB, 74.00 MB - FirstBatchArrivalWaitTime: 3m23s - TotalBytesReceived: 81.38 MB (85335164) - TotalGetBatchTime: 4m20s - DataArrivalTimer: 4m20s SenderSide: - DeserializeRowBatchTime: 1s285ms - NumBatchesAccepted: 82 (82) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m16s, non-child: 7s415ms, % non-child: 2.34%) - ConvertRowBatchTime: 2s885ms - PeakMemoryUsage: 0 - RowsReturned: 118.28M (118276440) - RowsReturnedRate: 373.52 K/sec RecvrSide: BytesReceived(16s000ms): 9.01 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 18.21 MB, 95.39 MB, 246.40 MB, 439.18 MB, 651.47 MB, 877.06 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.64 GB (3903122520) - TotalGetBatchTime: 5m13s - DataArrivalTimer: 5m9s SenderSide: - DeserializeRowBatchTime: 1m53s - NumBatchesAccepted: 5.64K (5640) - NumBatchesDeferred: 26 (26) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 130.563ms - CumulativeAllocationBytes: 100.00 MB (104857600) - CumulativeAllocations: 50 (50) - PeakReservation: 100.00 MB (104857600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 100.00 MB (104857600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b7 (host=vc1525.foo.com:22000):(Total: 418.061ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.79 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 19.90 MB, 22.59 MB, 94.09 MB, 98.77 MB, 121.06 MB, 148.19 MB, 250.58 MB, 477.30 MB, 768.28 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.40 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.58 GB (5991940188) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.69 GB (6110597323) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 418.000ms - ExecTreePrepareTime: 12.618ms KrpcDataStreamSender (dst_id=26):(Total: 125.125ms, non-child: 125.125ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s538ms, non-child: 1s538ms, % non-child: 100.00%) - CodegenTime: 3.222ms - CompileTime: 545.200ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 175 (175) - NumInstructions: 8.50K (8498) - OptimizationTime: 783.583ms - PeakMemoryUsage: 4.15 MB (4350976) - PrepareTime: 188.777ms AGGREGATION_NODE (id=15):(Total: 12.614ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 22.047ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 33.523ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 32.131ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.730ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 426.258us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s800ms, non-child: 89.576us, % non-child: 0.00%) - ConvertRowBatchTime: 66.511us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 394.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s800ms - DataArrivalTimer: 3s800ms SenderSide: - DeserializeRowBatchTime: 478.403us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 18.391ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 14.735ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 14.059ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 14.227ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 255.389us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 72.338us, non-child: 72.338us, % non-child: 100.00%) - ConvertRowBatchTime: 44.495us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 15.15 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.826us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 51.611us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 305.45K (305452) - BuildTime: 835.534ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 117.60M (117604352) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s510ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 657.465ms - BuildRowsPartitioned: 305.45K (305452) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.272ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 113.005ms, % non-child: 0.04%) - ConvertRowBatchTime: 10.768ms - PeakMemoryUsage: 0 - RowsReturned: 305.45K (305452) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.39 MB, 38.84 MB, 40.99 MB, 40.99 MB, 42.85 MB, 63.81 MB, 77.49 MB, 82.49 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.23 MB (87273038) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 1s049ms - NumBatchesAccepted: 109 (109) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m11s, non-child: 8s972ms, % non-child: 2.88%) - ConvertRowBatchTime: 2s867ms - PeakMemoryUsage: 0 - RowsReturned: 117.61M (117605368) - RowsReturnedRate: 377.44 K/sec RecvrSide: BytesReceived(16s000ms): 8.89 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 15.41 MB, 93.86 MB, 243.93 MB, 436.33 MB, 650.41 MB, 872.29 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.09 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.61 GB (3880977144) - TotalGetBatchTime: 5m8s - DataArrivalTimer: 5m2s SenderSide: - DeserializeRowBatchTime: 1m54s - NumBatchesAccepted: 5.61K (5608) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 43.557ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b4 (host=vc1508.foo.com:22000):(Total: 409.475ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.55 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 26.61 MB, 93.90 MB, 98.48 MB, 124.04 MB, 149.80 MB, 256.51 MB, 486.32 MB, 772.73 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.80 GB, 5.09 GB, 5.40 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.76 GB (6188540316) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.88 GB (6308617843) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 409.419ms - ExecTreePrepareTime: 13.194ms KrpcDataStreamSender (dst_id=26):(Total: 161.213ms, non-child: 161.213ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s079ms, non-child: 1s079ms, % non-child: 100.00%) - CodegenTime: 3.256ms - CompileTime: 307.306ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 613.124ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 158.289ms AGGREGATION_NODE (id=15):(Total: 13.193ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 25.949ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 30.666ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 29.441ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2.864ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.536ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s900ms, non-child: 65.612us, % non-child: 0.00%) - ConvertRowBatchTime: 45.760us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 517.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s900ms - DataArrivalTimer: 2s900ms SenderSide: - DeserializeRowBatchTime: 3.372ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 23.106ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 1s046ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 1s045ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s045ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 338.945us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 45.519ms, non-child: 64.286us, % non-child: 0.14%) - ConvertRowBatchTime: 36.256us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 24.08 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 45.474ms - DataArrivalTimer: 45.456ms SenderSide: - DeserializeRowBatchTime: 55.596us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 306.90K (306900) - BuildTime: 337.966ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 121.65M (121652224) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s436ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 252.692ms - BuildRowsPartitioned: 306.90K (306900) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.733ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 17.252ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.577ms - PeakMemoryUsage: 0 - RowsReturned: 306.90K (306900) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5.34 MB, 40.28 MB, 41.04 MB, 41.04 MB, 48.80 MB, 68.06 MB, 79.69 MB, 82.63 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.73 MB (87793136) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 958.915ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m25s, non-child: 7s285ms, % non-child: 2.24%) - ConvertRowBatchTime: 2s943ms - PeakMemoryUsage: 0 - RowsReturned: 121.65M (121652771) - RowsReturnedRate: 373.23 K/sec RecvrSide: BytesReceived(16s000ms): 8.79 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.00 MB, 98.05 MB, 250.11 MB, 442.11 MB, 655.28 MB, 881.02 MB, 1.07 GB, 1.23 GB, 1.38 GB, 1.53 GB, 1.70 GB, 1.87 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.30 GB, 3.50 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.74 GB (4014541443) - TotalGetBatchTime: 5m22s - DataArrivalTimer: 5m18s SenderSide: - DeserializeRowBatchTime: 2m3s - NumBatchesAccepted: 5.80K (5801) - NumBatchesDeferred: 26 (26) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 7.647ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ab (host=vc1529.foo.com:22000):(Total: 392.792ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.26 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 22.94 MB, 95.44 MB, 99.43 MB, 109.06 MB, 148.03 MB, 256.15 MB, 484.90 MB, 775.30 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.21 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.72 GB (6144237428) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.84 GB (6268476317) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 392.735ms - ExecTreePrepareTime: 6.950ms KrpcDataStreamSender (dst_id=26):(Total: 180.332ms, non-child: 180.332ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s173ms, non-child: 1s173ms, % non-child: 100.00%) - CodegenTime: 3.267ms - CompileTime: 366.273ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 645.896ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 159.431ms AGGREGATION_NODE (id=15):(Total: 6.948ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 13.480ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 13.081ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 11.860ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 12.366ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 338.196us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s205ms, non-child: 63.493us, % non-child: 0.00%) - ConvertRowBatchTime: 42.736us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 356.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s205ms - DataArrivalTimer: 4s205ms SenderSide: - DeserializeRowBatchTime: 389.301us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12.872ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 7.417ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 6.664ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 6.793ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 373.779us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 944.823ms, non-child: 41.497us, % non-child: 0.00%) - ConvertRowBatchTime: 27.927us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 944.788ms - DataArrivalTimer: 944.783ms SenderSide: - DeserializeRowBatchTime: 64.793us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m18s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 302.18K (302178) - BuildTime: 409.381ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 120.60M (120603648) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s300ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 294.653ms - BuildRowsPartitioned: 302.18K (302178) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.051ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m18s, non-child: 17.641ms, % non-child: 0.01%) - ConvertRowBatchTime: 9.589ms - PeakMemoryUsage: 0 - RowsReturned: 302.18K (302178) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.88 MB, 38.74 MB, 41.10 MB, 41.10 MB, 42.28 MB, 50.21 MB, 66.66 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 82.64 MB (86650222) - TotalGetBatchTime: 4m18s - DataArrivalTimer: 4m18s SenderSide: - DeserializeRowBatchTime: 450.648ms - NumBatchesAccepted: 96 (96) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m26s, non-child: 7s991ms, % non-child: 2.45%) - ConvertRowBatchTime: 2s941ms - PeakMemoryUsage: 0 - RowsReturned: 120.60M (120604221) - RowsReturnedRate: 369.36 K/sec RecvrSide: BytesReceived(16s000ms): 9.05 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 20.93 MB, 97.24 MB, 248.86 MB, 441.10 MB, 651.98 MB, 876.15 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.53 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.71 GB (3981323379) - TotalGetBatchTime: 5m23s - DataArrivalTimer: 5m18s SenderSide: - DeserializeRowBatchTime: 2m6s - NumBatchesAccepted: 5.75K (5753) - NumBatchesDeferred: 30 (30) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 67.260ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ac (host=vc1526.foo.com:22000):(Total: 349.062ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.87 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 22.50 MB, 96.42 MB, 101.42 MB, 126.35 MB, 151.48 MB, 254.08 MB, 483.98 MB, 770.57 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.67 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.80 GB, 5.09 GB, 5.40 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.54 GB (5948153716) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.64 GB (6060594284) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 349.004ms - ExecTreePrepareTime: 11.772ms KrpcDataStreamSender (dst_id=26):(Total: 114.668ms, non-child: 114.668ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s335ms, non-child: 1s335ms, % non-child: 100.00%) - CodegenTime: 5.965ms - CompileTime: 388.024ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 751.243ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 193.362ms AGGREGATION_NODE (id=15):(Total: 11.771ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 23.165ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 16.887ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 15.853ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.255ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.404ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s239ms, non-child: 72.410us, % non-child: 0.00%) - ConvertRowBatchTime: 45.085us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 353.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s239ms - DataArrivalTimer: 4s239ms SenderSide: - DeserializeRowBatchTime: 18.568ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 22.612ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 28.248ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 27.646ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.789ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 278.941us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 28.354us, non-child: 28.354us, % non-child: 100.00%) - ConvertRowBatchTime: 17.534us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 38.65 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 3.950us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 41.005us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m20s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 305.33K (305333) - BuildTime: 596.477ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 116.77M (116765696) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s712ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 486.085ms - BuildRowsPartitioned: 305.33K (305333) - HashBuckets: 589.82K (589824) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.718ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m19s, non-child: 131.424ms, % non-child: 0.05%) - ConvertRowBatchTime: 10.380ms - PeakMemoryUsage: 0 - RowsReturned: 305.33K (305333) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.59 MB, 38.90 MB, 40.90 MB, 40.90 MB, 43.80 MB, 62.17 MB, 76.86 MB, 82.01 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 83.06 MB (87092726) - TotalGetBatchTime: 4m19s - DataArrivalTimer: 4m19s SenderSide: - DeserializeRowBatchTime: 1s124ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m12s, non-child: 8s560ms, % non-child: 2.74%) - ConvertRowBatchTime: 2s845ms - PeakMemoryUsage: 0 - RowsReturned: 116.77M (116766528) - RowsReturnedRate: 373.30 K/sec RecvrSide: BytesReceived(16s000ms): 9.01 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 19.08 MB, 97.51 MB, 249.70 MB, 438.93 MB, 651.47 MB, 874.58 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.02 GB, 2.18 GB, 2.34 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.50 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.59 GB (3853295424) - TotalGetBatchTime: 5m9s - DataArrivalTimer: 5m4s SenderSide: - DeserializeRowBatchTime: 2m1s - NumBatchesAccepted: 5.57K (5568) - NumBatchesDeferred: 28 (28) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 236.145ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c4 (host=vc1522.foo.com:22000):(Total: 341.373ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.28 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 87.02 MB, 93.89 MB, 94.73 MB, 120.55 MB, 240.30 MB, 465.31 MB, 750.57 MB, 1.05 GB, 1.38 GB, 1.69 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.14 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.18 GB, 4.46 GB, 4.77 GB, 5.07 GB, 5.38 GB, 5.60 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.86 GB (6293135220) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.96 GB (6402807007) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 341.313ms - ExecTreePrepareTime: 2.312ms KrpcDataStreamSender (dst_id=26):(Total: 104.395ms, non-child: 104.395ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s087ms, non-child: 1s087ms, % non-child: 100.00%) - CodegenTime: 3.716ms - CompileTime: 302.311ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 628.314ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 154.343ms AGGREGATION_NODE (id=15):(Total: 2.311ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 4.123ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 5.962ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 5.001ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 726.030us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 5.037ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s964ms, non-child: 56.254us, % non-child: 0.00%) - ConvertRowBatchTime: 37.604us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 506.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s964ms - DataArrivalTimer: 2s964ms SenderSide: - DeserializeRowBatchTime: 302.161us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 3.548ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 654.135us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 10.220us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 171.509us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 248.038us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 2s238ms, non-child: 52.731us, % non-child: 0.00%) - ConvertRowBatchTime: 39.979us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 489.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 2s238ms - DataArrivalTimer: 2s238ms SenderSide: - DeserializeRowBatchTime: 69.347us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 292.89K (292891) - BuildTime: 618.966ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 123.67M (123665408) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s895ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 530.456ms - BuildRowsPartitioned: 292.89K (292891) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.112ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m24s, non-child: 56.377ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.336ms - PeakMemoryUsage: 0 - RowsReturned: 292.89K (292891) - RowsReturnedRate: 1.11 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 32.78 MB, 41.03 MB, 41.03 MB, 41.03 MB, 41.03 MB, 42.60 MB, 57.63 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 79.85 MB (83724010) - TotalGetBatchTime: 4m24s - DataArrivalTimer: 4m24s SenderSide: - DeserializeRowBatchTime: 921.409ms - NumBatchesAccepted: 74 (74) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m30s, non-child: 6s876ms, % non-child: 2.08%) - ConvertRowBatchTime: 3s002ms - PeakMemoryUsage: 0 - RowsReturned: 123.67M (123665987) - RowsReturnedRate: 374.70 K/sec RecvrSide: BytesReceived(16s000ms): 8.74 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 11.74 MB, 88.42 MB, 237.68 MB, 426.16 MB, 638.43 MB, 861.53 MB, 1.05 GB, 1.21 GB, 1.36 GB, 1.52 GB, 1.68 GB, 1.85 GB, 2.01 GB, 2.17 GB, 2.33 GB, 2.50 GB, 2.69 GB, 2.87 GB, 3.08 GB, 3.28 GB, 3.48 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.80 GB (4080977571) - TotalGetBatchTime: 5m26s - DataArrivalTimer: 5m23s SenderSide: - DeserializeRowBatchTime: 1m57s - NumBatchesAccepted: 5.90K (5897) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 36.587ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ca (host=vc1540.foo.com:22000):(Total: 324.262ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.94 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 21.12 MB, 90.75 MB, 96.89 MB, 97.44 MB, 116.63 MB, 241.06 MB, 470.81 MB, 757.91 MB, 1.05 GB, 1.38 GB, 1.70 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.14 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.07 GB, 5.38 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.56 GB (5971484604) - PeakReservation: 101.88 MB (106823680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.66 GB (6072597647) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m35s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 324.187ms - ExecTreePrepareTime: 64.978ms KrpcDataStreamSender (dst_id=26):(Total: 112.630ms, non-child: 112.630ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s261ms, non-child: 1s261ms, % non-child: 100.00%) - CodegenTime: 3.808ms - CompileTime: 372.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 754.570ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 132.269ms AGGREGATION_NODE (id=15):(Total: 64.976ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 94.448ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 7.652ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 6.357ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 6.832ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 494.261us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s198ms, non-child: 84.671us, % non-child: 0.00%) - ConvertRowBatchTime: 61.232us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 357.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s198ms - DataArrivalTimer: 4s198ms SenderSide: - DeserializeRowBatchTime: 282.598us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 46.694ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 22.005ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 21.001ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.196ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 471.534us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 63.490us, non-child: 63.490us, % non-child: 100.00%) - ConvertRowBatchTime: 45.238us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 17.26 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.438us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 31.130us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m29s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 292.36K (292359) - BuildTime: 533.099ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 98.13 MB (102895872) - ProbeRows: 117.31M (117311488) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s194ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 306.731ms - BuildRowsPartitioned: 292.36K (292359) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 158.850ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m28s, non-child: 31.627ms, % non-child: 0.01%) - ConvertRowBatchTime: 9.477ms - PeakMemoryUsage: 0 - RowsReturned: 292.36K (292359) - RowsReturnedRate: 1.09 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 140.84 KB, 33.55 MB, 40.78 MB, 40.78 MB, 40.78 MB, 40.78 MB, 41.43 MB, 54.66 MB, 73.21 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 79.28 MB (83126685) - TotalGetBatchTime: 4m28s - DataArrivalTimer: 4m28s SenderSide: - DeserializeRowBatchTime: 408.730ms - NumBatchesAccepted: 74 (74) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m5s, non-child: 7s602ms, % non-child: 2.49%) - ConvertRowBatchTime: 2s873ms - PeakMemoryUsage: 0 - RowsReturned: 117.31M (117311774) - RowsReturnedRate: 383.63 K/sec RecvrSide: BytesReceived(16s000ms): 8.91 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 90.38 MB, 244.13 MB, 433.82 MB, 644.85 MB, 868.27 MB, 1.05 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.61 GB (3871980585) - TotalGetBatchTime: 5m2s - DataArrivalTimer: 4m58s SenderSide: - DeserializeRowBatchTime: 1m39s - NumBatchesAccepted: 5.59K (5595) - NumBatchesDeferred: 52 (52) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 155.736ms - CumulativeAllocationBytes: 98.00 MB (102760448) - CumulativeAllocations: 49 (49) - PeakReservation: 98.00 MB (102760448) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 98.00 MB (102760448) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000bd (host=vc1502.foo.com:22000):(Total: 323.649ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.60 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 22.51 MB, 89.32 MB, 95.95 MB, 131.99 MB, 145.87 MB, 243.98 MB, 470.97 MB, 762.45 MB, 1.06 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.20 GB, 4.47 GB, 4.78 GB, 5.08 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.56 GB (5968338780) - PeakReservation: 103.88 MB (108920832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.67 GB (6086319401) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 323.584ms - ExecTreePrepareTime: 10.330ms KrpcDataStreamSender (dst_id=26):(Total: 116.509ms, non-child: 116.509ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) - CodegenTime: 3.618ms - CompileTime: 285.841ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 642.826ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 119.241ms AGGREGATION_NODE (id=15):(Total: 10.328ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 16.480ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 2.591ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 1.790ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2.077ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 380.301us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s430ms, non-child: 49.146us, % non-child: 0.00%) - ConvertRowBatchTime: 30.776us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 338.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s430ms - DataArrivalTimer: 4s430ms SenderSide: - DeserializeRowBatchTime: 425.436us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 15.821ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 444.480us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 6.981us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 111.775us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 122.792us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 40.038us, non-child: 40.038us, % non-child: 100.00%) - ConvertRowBatchTime: 28.789us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 27.37 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 5.369us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 64.229us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 308.56K (308565) - BuildTime: 680.375ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 100.13 MB (104993024) - ProbeRows: 117.19M (117193728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s253ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 573.732ms - BuildRowsPartitioned: 308.56K (308565) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 74.131ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 13.432ms, % non-child: 0.01%) - ConvertRowBatchTime: 11.188ms - PeakMemoryUsage: 0 - RowsReturned: 308.56K (308565) - RowsReturnedRate: 1.17 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.41 MB, 39.42 MB, 40.79 MB, 40.79 MB, 51.19 MB, 74.09 MB, 81.32 MB, 82.85 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.65 MB (87715414) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 552.268ms - NumBatchesAccepted: 111 (111) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m9s, non-child: 5s009ms, % non-child: 1.62%) - ConvertRowBatchTime: 2s887ms - PeakMemoryUsage: 0 - RowsReturned: 117.19M (117193728) - RowsReturnedRate: 378.32 K/sec RecvrSide: BytesReceived(16s000ms): 8.87 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 13.82 MB, 92.17 MB, 242.42 MB, 434.83 MB, 646.17 MB, 869.47 MB, 1.05 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.60 GB (3867828327) - TotalGetBatchTime: 5m6s - DataArrivalTimer: 5m4s SenderSide: - DeserializeRowBatchTime: 1m27s - NumBatchesAccepted: 5.59K (5589) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 75.660ms - CumulativeAllocationBytes: 100.00 MB (104857600) - CumulativeAllocations: 50 (50) - PeakReservation: 100.00 MB (104857600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 100.00 MB (104857600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a8 (host=vc1519.foo.com:22000):(Total: 311.463ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.37 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 20.87 MB, 86.78 MB, 93.14 MB, 100.76 MB, 143.73 MB, 242.02 MB, 465.73 MB, 756.20 MB, 1.05 GB, 1.38 GB, 1.70 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.15 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.77 GB, 5.07 GB, 5.38 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.71 GB (6127198284) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.81 GB (6242663911) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 311.381ms - ExecTreePrepareTime: 23.719ms KrpcDataStreamSender (dst_id=26):(Total: 123.048ms, non-child: 123.048ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s277ms, non-child: 1s277ms, % non-child: 100.00%) - CodegenTime: 3.945ms - CompileTime: 390.379ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 768.115ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 116.496ms AGGREGATION_NODE (id=15):(Total: 23.718ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 46.975ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 28.610ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 27.440ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 27.969ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 404.097us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s095ms, non-child: 70.081us, % non-child: 0.00%) - ConvertRowBatchTime: 46.251us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 366.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s095ms - DataArrivalTimer: 4s095ms SenderSide: - DeserializeRowBatchTime: 896.578us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 46.320ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 32.591ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 31.683ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 31.924ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 405.696us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 49.891us, non-child: 49.891us, % non-child: 100.00%) - ConvertRowBatchTime: 32.140us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 21.97 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 7.808us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 46.573us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m18s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 299.70K (299705) - BuildTime: 447.135ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 120.39M (120393728) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s416ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 352.055ms - BuildRowsPartitioned: 299.70K (299705) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.856ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m17s, non-child: 20.214ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.698ms - PeakMemoryUsage: 0 - RowsReturned: 299.70K (299705) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 212.01 KB, 34.85 MB, 40.77 MB, 40.77 MB, 40.77 MB, 41.53 MB, 60.32 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 81.25 MB (85193887) - TotalGetBatchTime: 4m17s - DataArrivalTimer: 4m17s SenderSide: - DeserializeRowBatchTime: 448.884ms - NumBatchesAccepted: 91 (91) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m26s, non-child: 7s851ms, % non-child: 2.40%) - ConvertRowBatchTime: 2s929ms - PeakMemoryUsage: 0 - RowsReturned: 120.39M (120394511) - RowsReturnedRate: 368.75 K/sec RecvrSide: BytesReceived(16s000ms): 8.70 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 21.20 MB, 91.08 MB, 239.78 MB, 431.53 MB, 642.72 MB, 865.75 MB, 1.05 GB, 1.22 GB, 1.36 GB, 1.52 GB, 1.68 GB, 1.85 GB, 2.01 GB, 2.17 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.08 GB, 3.28 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.70 GB (3973018863) - TotalGetBatchTime: 5m23s - DataArrivalTimer: 5m18s SenderSide: - DeserializeRowBatchTime: 2m7s - NumBatchesAccepted: 5.74K (5741) - NumBatchesDeferred: 27 (27) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 82.897ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c1 (host=vc1531.foo.com:22000):(Total: 309.386ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.01 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 20.15 MB, 22.63 MB, 91.10 MB, 95.96 MB, 99.94 MB, 129.84 MB, 245.30 MB, 471.41 MB, 761.08 MB, 1.06 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.78 GB, 5.08 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.49 GB (5900189740) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.61 GB (6028077422) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 309.315ms - ExecTreePrepareTime: 16.289ms KrpcDataStreamSender (dst_id=26):(Total: 90.428ms, non-child: 90.428ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s304ms, non-child: 1s304ms, % non-child: 100.00%) - CodegenTime: 12.189ms - CompileTime: 381.779ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 175 (175) - NumInstructions: 8.50K (8498) - OptimizationTime: 802.898ms - PeakMemoryUsage: 4.15 MB (4350976) - PrepareTime: 116.009ms AGGREGATION_NODE (id=15):(Total: 16.287ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 32.088ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 5.722ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 4.555ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5.104ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 344.620us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s050ms, non-child: 55.064us, % non-child: 0.00%) - ConvertRowBatchTime: 36.552us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 370.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s050ms - DataArrivalTimer: 4s050ms SenderSide: - DeserializeRowBatchTime: 5.700ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 17.723ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 673.954us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 10.744us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 132.159us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 197.235us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 43.796us, non-child: 43.796us, % non-child: 100.00%) - ConvertRowBatchTime: 31.297us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 25.03 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 6.193us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 28.291us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m25s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 299.96K (299965) - BuildTime: 334.878ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 115.76M (115759104) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s593ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 258.118ms - BuildRowsPartitioned: 299.96K (299965) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.146ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m24s, non-child: 19.871ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.179ms - PeakMemoryUsage: 0 - RowsReturned: 299.96K (299965) - RowsReturnedRate: 1.13 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 423.32 KB, 36.60 MB, 40.88 MB, 40.88 MB, 40.95 MB, 45.11 MB, 52.48 MB, 69.42 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 81.60 MB (85568050) - TotalGetBatchTime: 4m24s - DataArrivalTimer: 4m24s SenderSide: - DeserializeRowBatchTime: 695.329ms - NumBatchesAccepted: 89 (89) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m4s, non-child: 8s041ms, % non-child: 2.64%) - ConvertRowBatchTime: 2s819ms - PeakMemoryUsage: 0 - RowsReturned: 115.76M (115759920) - RowsReturnedRate: 380.31 K/sec RecvrSide: BytesReceived(16s000ms): 8.87 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 12.54 MB, 90.29 MB, 240.07 MB, 431.28 MB, 643.75 MB, 867.32 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.56 GB (3820077360) - TotalGetBatchTime: 5m1s - DataArrivalTimer: 4m56s SenderSide: - DeserializeRowBatchTime: 1m53s - NumBatchesAccepted: 5.52K (5520) - NumBatchesDeferred: 28 (28) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 21.713ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c5 (host=vc1501.foo.com:22000):(Total: 300.753ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.37 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 20.92 MB, 95.86 MB, 102.45 MB, 108.44 MB, 140.02 MB, 241.63 MB, 469.82 MB, 754.63 MB, 1.05 GB, 1.38 GB, 1.69 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.15 GB, 3.40 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.77 GB, 5.07 GB, 5.38 GB, 5.60 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.83 GB (6263513068) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6393546079) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m54s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 300.702ms - ExecTreePrepareTime: 19.069ms KrpcDataStreamSender (dst_id=26):(Total: 94.825ms, non-child: 94.825ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s253ms, non-child: 1s253ms, % non-child: 100.00%) - CodegenTime: 4.899ms - CompileTime: 338.036ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 813.959ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 99.624ms AGGREGATION_NODE (id=15):(Total: 19.068ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 37.739ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 10.243ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 8.899ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.485ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 543.707us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s294ms, non-child: 63.576us, % non-child: 0.00%) - ConvertRowBatchTime: 42.255us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 349.00 /sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s294ms - DataArrivalTimer: 4s294ms SenderSide: - DeserializeRowBatchTime: 6.065ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 37.214ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 11.042ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 11.390us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 170.962us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 10.534ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 876.746ms, non-child: 61.002us, % non-child: 0.01%) - ConvertRowBatchTime: 46.194us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.25 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 876.691ms - DataArrivalTimer: 876.685ms SenderSide: - DeserializeRowBatchTime: 55.617us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m27s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 302.76K (302761) - BuildTime: 337.465ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 123.06M (123057152) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s632ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 242.530ms - BuildRowsPartitioned: 302.76K (302761) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.585ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m26s, non-child: 90.054ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.606ms - PeakMemoryUsage: 0 - RowsReturned: 302.76K (302761) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 285.02 KB, 35.88 MB, 41.09 MB, 41.09 MB, 41.85 MB, 50.86 MB, 65.99 MB, 76.01 MB, 81.30 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 82.69 MB (86709949) - TotalGetBatchTime: 4m26s - DataArrivalTimer: 4m26s SenderSide: - DeserializeRowBatchTime: 696.999ms - NumBatchesAccepted: 101 (101) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m25s, non-child: 6s913ms, % non-child: 2.12%) - ConvertRowBatchTime: 2s988ms - PeakMemoryUsage: 0 - RowsReturned: 123.06M (123057828) - RowsReturnedRate: 378.03 K/sec RecvrSide: BytesReceived(16s000ms): 8.74 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 87.18 MB, 239.06 MB, 427.11 MB, 639.77 MB, 863.01 MB, 1.05 GB, 1.21 GB, 1.36 GB, 1.52 GB, 1.68 GB, 1.85 GB, 2.01 GB, 2.17 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.08 GB, 3.28 GB, 3.48 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.78 GB (4060908324) - TotalGetBatchTime: 5m22s - DataArrivalTimer: 5m18s SenderSide: - DeserializeRowBatchTime: 1m44s - NumBatchesAccepted: 5.87K (5868) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 90.908us - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c3 (host=vc1520.foo.com:22000):(Total: 294.156ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.48 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 19.39 MB, 21.80 MB, 92.15 MB, 96.77 MB, 106.69 MB, 137.34 MB, 244.09 MB, 469.88 MB, 758.70 MB, 1.05 GB, 1.39 GB, 1.70 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.15 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.07 GB, 5.38 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.54 GB (5948415932) - PeakReservation: 101.88 MB (106823680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.64 GB (6055069891) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m34s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 294.083ms - ExecTreePrepareTime: 13.463ms KrpcDataStreamSender (dst_id=26):(Total: 139.783ms, non-child: 139.783ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s313ms, non-child: 1s313ms, % non-child: 100.00%) - CodegenTime: 4.162ms - CompileTime: 435.551ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 770.863ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 103.845ms AGGREGATION_NODE (id=15):(Total: 13.461ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 26.305ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 3.508ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 2.432ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 2.861ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 395.887us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s227ms, non-child: 65.675us, % non-child: 0.00%) - ConvertRowBatchTime: 47.234us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 354.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s227ms - DataArrivalTimer: 4s227ms SenderSide: - DeserializeRowBatchTime: 306.742us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 25.536ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 21.700ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 20.867ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 21.124ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 283.063us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 904.044ms, non-child: 48.997us, % non-child: 0.01%) - ConvertRowBatchTime: 30.838us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 1.21 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 904.004ms - DataArrivalTimer: 903.996ms SenderSide: - DeserializeRowBatchTime: 33.885us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 301.14K (301145) - BuildTime: 635.757ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 98.13 MB (102895872) - ProbeRows: 116.86M (116860928) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 17s671ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 513.375ms - BuildRowsPartitioned: 301.14K (301145) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 40.457ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 22.256ms, % non-child: 0.01%) - ConvertRowBatchTime: 9.932ms - PeakMemoryUsage: 0 - RowsReturned: 301.14K (301145) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 281.59 KB, 36.74 MB, 40.66 MB, 40.66 MB, 41.07 MB, 46.30 MB, 59.09 MB, 72.20 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 81.46 MB (85415359) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 1s491ms - NumBatchesAccepted: 93 (93) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m8s, non-child: 7s785ms, % non-child: 2.52%) - ConvertRowBatchTime: 2s823ms - PeakMemoryUsage: 0 - RowsReturned: 116.86M (116860928) - RowsReturnedRate: 378.84 K/sec RecvrSide: BytesReceived(16s000ms): 8.89 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 13.39 MB, 93.99 MB, 243.55 MB, 434.17 MB, 646.25 MB, 870.66 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB, 3.49 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.59 GB (3856755639) - TotalGetBatchTime: 5m5s - DataArrivalTimer: 5m SenderSide: - DeserializeRowBatchTime: 2m - NumBatchesAccepted: 5.57K (5573) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 108.684ms - CumulativeAllocationBytes: 98.00 MB (102760448) - CumulativeAllocations: 49 (49) - PeakReservation: 98.00 MB (102760448) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 98.00 MB (102760448) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c7 (host=vc1503.foo.com:22000):(Total: 292.064ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.10 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 24.15 MB, 95.23 MB, 100.45 MB, 120.79 MB, 150.10 MB, 251.61 MB, 480.55 MB, 768.54 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.91 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.39 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.88 GB (6309388196) - PeakReservation: 109.88 MB (115212288) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.99 GB (6428671174) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 291.981ms - ExecTreePrepareTime: 14.020ms KrpcDataStreamSender (dst_id=26):(Total: 150.223ms, non-child: 150.223ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s097ms, non-child: 1s097ms, % non-child: 100.00%) - CodegenTime: 2.823ms - CompileTime: 299.956ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 705.080ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 90.810ms AGGREGATION_NODE (id=15):(Total: 14.018ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 27.371ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 1.935ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 898.856us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1.320ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 378.015us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s050ms, non-child: 65.599us, % non-child: 0.00%) - ConvertRowBatchTime: 44.323us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 370.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s050ms - DataArrivalTimer: 4s050ms SenderSide: - DeserializeRowBatchTime: 1.679ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 12.521ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 472.608us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.169us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 114.828us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 130.844us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 41.528us, non-child: 41.528us, % non-child: 100.00%) - ConvertRowBatchTime: 31.469us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 26.39 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 4.043us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 2.645ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m29s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 305.50K (305498) - BuildTime: 639.130ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 106.13 MB (111284480) - ProbeRows: 123.92M (123917312) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s656ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 555.085ms - BuildRowsPartitioned: 305.50K (305498) - HashBuckets: 589.82K (589824) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.405ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m28s, non-child: 71.020ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.672ms - PeakMemoryUsage: 0 - RowsReturned: 305.50K (305498) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.01 MB, 39.05 MB, 40.98 MB, 40.98 MB, 44.79 MB, 59.61 MB, 76.88 MB, 82.42 MB, 83.10 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.29 MB (87332707) - TotalGetBatchTime: 4m28s - DataArrivalTimer: 4m28s SenderSide: - DeserializeRowBatchTime: 841.026ms - NumBatchesAccepted: 110 (110) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m27s, non-child: 7s065ms, % non-child: 2.16%) - ConvertRowBatchTime: 3s026ms - PeakMemoryUsage: 0 - RowsReturned: 123.92M (123917639) - RowsReturnedRate: 378.25 K/sec RecvrSide: BytesReceived(16s000ms): 8.95 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 92.58 MB, 245.62 MB, 435.71 MB, 648.68 MB, 873.10 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.29 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.81 GB (4089282087) - TotalGetBatchTime: 5m24s - DataArrivalTimer: 5m20s SenderSide: - DeserializeRowBatchTime: 1m49s - NumBatchesAccepted: 5.91K (5909) - NumBatchesDeferred: 44 (44) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 149.152ms - CumulativeAllocationBytes: 106.00 MB (111149056) - CumulativeAllocations: 53 (53) - PeakReservation: 106.00 MB (111149056) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 106.00 MB (111149056) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000c2 (host=vc1533.foo.com:22000):(Total: 255.204ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.99 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 19.65 MB, 22.39 MB, 97.59 MB, 103.48 MB, 121.60 MB, 150.14 MB, 244.42 MB, 471.02 MB, 758.72 MB, 1.05 GB, 1.39 GB, 1.70 GB, 1.95 GB, 2.18 GB, 2.41 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.65 GB, 3.91 GB, 4.19 GB, 4.47 GB, 4.78 GB, 5.08 GB, 5.38 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 5.74 GB (6162595844) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.84 GB (6275436973) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 255.153ms - ExecTreePrepareTime: 4.283ms KrpcDataStreamSender (dst_id=26):(Total: 98.071ms, non-child: 98.071ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s143ms, non-child: 1s143ms, % non-child: 100.00%) - CodegenTime: 5.596ms - CompileTime: 346.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 175 (175) - NumInstructions: 8.50K (8498) - OptimizationTime: 677.949ms - PeakMemoryUsage: 4.15 MB (4350976) - PrepareTime: 112.098ms AGGREGATION_NODE (id=15):(Total: 4.282ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 7.157ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 8.377ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 16.742us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.593ms - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 455.959us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 3s003ms, non-child: 71.727us, % non-child: 0.00%) - ConvertRowBatchTime: 48.598us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 499.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 3s003ms - DataArrivalTimer: 3s003ms SenderSide: - DeserializeRowBatchTime: 4.793ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 2.953ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 615.917us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.920us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 126.920us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 224.040us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 2s485ms, non-child: 43.611us, % non-child: 0.00%) - ConvertRowBatchTime: 32.054us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 440.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 2s485ms - DataArrivalTimer: 2s485ms SenderSide: - DeserializeRowBatchTime: 48.009us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 305.96K (305957) - BuildTime: 1s174ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 121.03M (121027584) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s622ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 1s074ms - BuildRowsPartitioned: 305.96K (305957) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 64.226ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 27.760ms, % non-child: 0.01%) - ConvertRowBatchTime: 11.055ms - PeakMemoryUsage: 0 - RowsReturned: 305.96K (305957) - RowsReturnedRate: 1.16 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.45 MB, 36.45 MB, 40.87 MB, 40.87 MB, 43.28 MB, 62.56 MB, 77.83 MB, 81.91 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 83.14 MB (87182651) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 1s238ms - NumBatchesAccepted: 110 (110) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m21s, non-child: 6s607ms, % non-child: 2.06%) - ConvertRowBatchTime: 2s956ms - PeakMemoryUsage: 0 - RowsReturned: 121.03M (121027584) - RowsReturnedRate: 376.75 K/sec RecvrSide: BytesReceived(16s000ms): 8.91 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 12.81 MB, 90.71 MB, 240.71 MB, 430.74 MB, 642.08 MB, 868.04 MB, 1.06 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB, 3.49 GB, 3.64 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.72 GB (3994472196) - TotalGetBatchTime: 5m18s - DataArrivalTimer: 5m14s SenderSide: - DeserializeRowBatchTime: 1m58s - NumBatchesAccepted: 5.77K (5772) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 90.382ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b5 (host=vc1505.foo.com:22000):(Total: 225.433ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.73 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 19.64 MB, 22.37 MB, 90.81 MB, 94.89 MB, 103.13 MB, 137.99 MB, 244.18 MB, 471.48 MB, 758.04 MB, 1.05 GB, 1.38 GB, 1.70 GB, 1.95 GB, 2.17 GB, 2.40 GB, 2.66 GB, 2.92 GB, 3.15 GB, 3.40 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.08 GB, 5.38 GB, 5.61 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.79 GB (6212919204) - PeakReservation: 105.88 MB (111017984) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.89 GB (6323942440) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 225.384ms - ExecTreePrepareTime: 1.952ms KrpcDataStreamSender (dst_id=26):(Total: 64.251ms, non-child: 64.251ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 939.146ms, non-child: 939.146ms, % non-child: 100.00%) - CodegenTime: 3.732ms - CompileTime: 270.166ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 552.438ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 114.495ms AGGREGATION_NODE (id=15):(Total: 1.951ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 3.415ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 29.178ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 28.006ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 506.490us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 28.487ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s823ms, non-child: 61.851us, % non-child: 0.00%) - ConvertRowBatchTime: 46.784us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 531.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s823ms - DataArrivalTimer: 2s823ms SenderSide: - DeserializeRowBatchTime: 5.898ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 2.814ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 635.830us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 10.484us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 138.176us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 232.372us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 462.477ms, non-child: 42.409us, % non-child: 0.01%) - ConvertRowBatchTime: 29.304us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 2.37 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 462.441ms - DataArrivalTimer: 462.435ms SenderSide: - DeserializeRowBatchTime: 10.151ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m24s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 300.53K (300526) - BuildTime: 398.800ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 102.13 MB (107090176) - ProbeRows: 122.06M (122060800) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s859ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 313.036ms - BuildRowsPartitioned: 300.53K (300526) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.052ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m23s, non-child: 61.325ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.365ms - PeakMemoryUsage: 0 - RowsReturned: 300.53K (300526) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 990.37 KB, 36.79 MB, 40.87 MB, 40.87 MB, 40.87 MB, 43.28 MB, 59.96 MB, 74.33 MB - FirstBatchArrivalWaitTime: 3m23s - TotalBytesReceived: 81.78 MB (85749141) - TotalGetBatchTime: 4m23s - DataArrivalTimer: 4m23s SenderSide: - DeserializeRowBatchTime: 468.900ms - NumBatchesAccepted: 93 (93) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m27s, non-child: 6s906ms, % non-child: 2.11%) - ConvertRowBatchTime: 2s999ms - PeakMemoryUsage: 0 - RowsReturned: 122.06M (122060800) - RowsReturnedRate: 372.73 K/sec RecvrSide: BytesReceived(16s000ms): 8.85 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 15.70 MB, 91.35 MB, 242.30 MB, 431.42 MB, 642.54 MB, 866.74 MB, 1.05 GB, 1.22 GB, 1.37 GB, 1.52 GB, 1.69 GB, 1.86 GB, 2.01 GB, 2.18 GB, 2.34 GB, 2.51 GB, 2.70 GB, 2.88 GB, 3.09 GB, 3.28 GB, 3.49 GB, 3.63 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.75 GB (4028382303) - TotalGetBatchTime: 5m24s - DataArrivalTimer: 5m20s SenderSide: - DeserializeRowBatchTime: 1m44s - NumBatchesAccepted: 5.82K (5821) - NumBatchesDeferred: 30 (30) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 67.890ms - CumulativeAllocationBytes: 102.00 MB (106954752) - CumulativeAllocations: 51 (51) - PeakReservation: 102.00 MB (106954752) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 102.00 MB (106954752) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b9 (host=vc1528.foo.com:22000):(Total: 177.930ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.15 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 23.92 MB, 92.23 MB, 96.07 MB, 111.56 MB, 143.79 MB, 252.94 MB, 478.84 MB, 781.29 MB, 1.08 GB, 1.41 GB, 1.72 GB, 1.96 GB, 2.19 GB, 2.42 GB, 2.68 GB, 2.93 GB, 3.17 GB, 3.42 GB, 3.66 GB, 3.92 GB, 4.21 GB, 4.49 GB, 4.81 GB, 5.11 GB, 5.41 GB, 5.62 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.85 GB (6277406580) - PeakReservation: 101.88 MB (106823680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6389991016) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 177.874ms - ExecTreePrepareTime: 3.053ms KrpcDataStreamSender (dst_id=26):(Total: 60.747ms, non-child: 60.747ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 926.950ms, non-child: 926.950ms, % non-child: 100.00%) - CodegenTime: 2.827ms - CompileTime: 247.857ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 591.415ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 85.236ms AGGREGATION_NODE (id=15):(Total: 3.052ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 5.490ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 1.034ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 136.374us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 248.720us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 640.216us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s289ms, non-child: 68.274us, % non-child: 0.00%) - ConvertRowBatchTime: 50.990us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 349.00 /sec RecvrSide: BytesReceived(500.000ms): 64.91 KB, 64.91 KB, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s289ms - DataArrivalTimer: 4s289ms SenderSide: - DeserializeRowBatchTime: 500.528us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 4.852ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 1.535ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 867.190us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1.001ms - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 269.159us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 44.158us, non-child: 44.158us, % non-child: 100.00%) - ConvertRowBatchTime: 32.622us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 24.82 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 5.436us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 50.306us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m23s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 299.25K (299255) - BuildTime: 657.649ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 98.13 MB (102895872) - ProbeRows: 123.41M (123413504) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s970ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 587.322ms - BuildRowsPartitioned: 299.25K (299255) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 41.740ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 27.297ms, % non-child: 0.01%) - ConvertRowBatchTime: 10.240ms - PeakMemoryUsage: 0 - RowsReturned: 299.25K (299255) - RowsReturnedRate: 1.14 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.42 MB, 38.67 MB, 40.88 MB, 40.88 MB, 41.09 MB, 46.61 MB, 56.74 MB, 73.74 MB - FirstBatchArrivalWaitTime: 3m22s - TotalBytesReceived: 81.35 MB (85297029) - TotalGetBatchTime: 4m22s - DataArrivalTimer: 4m22s SenderSide: - DeserializeRowBatchTime: 703.294ms - NumBatchesAccepted: 87 (87) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m31s, non-child: 7s080ms, % non-child: 2.14%) - ConvertRowBatchTime: 3s018ms - PeakMemoryUsage: 0 - RowsReturned: 123.41M (123414335) - RowsReturnedRate: 372.76 K/sec RecvrSide: BytesReceived(16s000ms): 9.10 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 16.33 MB, 99.86 MB, 249.33 MB, 449.08 MB, 663.04 MB, 888.15 MB, 1.07 GB, 1.23 GB, 1.38 GB, 1.54 GB, 1.70 GB, 1.87 GB, 2.03 GB, 2.19 GB, 2.35 GB, 2.52 GB, 2.72 GB, 2.90 GB, 3.11 GB, 3.30 GB, 3.50 GB, 3.65 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.79 GB (4073365098) - TotalGetBatchTime: 5m28s - DataArrivalTimer: 5m24s SenderSide: - DeserializeRowBatchTime: 1m46s - NumBatchesAccepted: 5.89K (5886) - NumBatchesDeferred: 31 (31) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 331.716ms - CumulativeAllocationBytes: 98.00 MB (102760448) - CumulativeAllocations: 49 (49) - PeakReservation: 98.00 MB (102760448) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 98.00 MB (102760448) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000ba (host=vc1518.foo.com:22000):(Total: 162.879ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 18.42 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 20.14 MB, 22.66 MB, 92.60 MB, 97.98 MB, 111.36 MB, 145.95 MB, 246.69 MB, 472.66 MB, 758.21 MB, 1.05 GB, 1.38 GB, 1.70 GB, 1.94 GB, 2.17 GB, 2.40 GB, 2.65 GB, 2.91 GB, 3.15 GB, 3.39 GB, 3.64 GB, 3.90 GB, 4.19 GB, 4.46 GB, 4.78 GB, 5.07 GB, 5.38 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.69 GB (6108847964) - PeakReservation: 107.88 MB (113115136) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.80 GB (6232695536) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m44s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 162.824ms - ExecTreePrepareTime: 2.059ms KrpcDataStreamSender (dst_id=26):(Total: 55.909ms, non-child: 55.909ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 922.114ms, non-child: 922.114ms, % non-child: 100.00%) - CodegenTime: 3.196ms - CompileTime: 243.694ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 596.950ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 79.778ms AGGREGATION_NODE (id=15):(Total: 2.058ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 3.415ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 1.446ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 489.355us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 798.244us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 500.278us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 2s876ms, non-child: 30.077us, % non-child: 0.00%) - ConvertRowBatchTime: 18.763us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 521.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 2s876ms - DataArrivalTimer: 2s876ms SenderSide: - DeserializeRowBatchTime: 6.139ms - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 2.816ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 1.507ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 613.259us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 555.233us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 577.138us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 436.365ms, non-child: 50.281us, % non-child: 0.01%) - ConvertRowBatchTime: 35.144us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 2.51 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 436.323ms - DataArrivalTimer: 436.316ms SenderSide: - DeserializeRowBatchTime: 50.202us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m26s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 303.22K (303221) - BuildTime: 1s139ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 104.13 MB (109187328) - ProbeRows: 119.93M (119932928) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s197ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 563.828ms - BuildRowsPartitioned: 303.22K (303221) - HashBuckets: 557.06K (557056) - HashCollisions: 0 (0) - HashTablesBuildTime: 277.249ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m24s, non-child: 44.764ms, % non-child: 0.02%) - ConvertRowBatchTime: 10.285ms - PeakMemoryUsage: 0 - RowsReturned: 303.22K (303221) - RowsReturnedRate: 1.15 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 707.96 KB, 38.15 MB, 40.91 MB, 40.91 MB, 41.68 MB, 50.67 MB, 67.08 MB, 78.26 MB - FirstBatchArrivalWaitTime: 3m23s - TotalBytesReceived: 82.51 MB (86521351) - TotalGetBatchTime: 4m24s - DataArrivalTimer: 4m24s SenderSide: - DeserializeRowBatchTime: 529.369ms - NumBatchesAccepted: 102 (102) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m19s, non-child: 7s075ms, % non-child: 2.22%) - ConvertRowBatchTime: 2s920ms - PeakMemoryUsage: 0 - RowsReturned: 119.93M (119933149) - RowsReturnedRate: 375.85 K/sec RecvrSide: BytesReceived(16s000ms): 8.97 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 12.97 MB, 91.30 MB, 241.27 MB, 429.83 MB, 639.09 MB, 864.72 MB, 1.05 GB, 1.21 GB, 1.36 GB, 1.52 GB, 1.68 GB, 1.85 GB, 2.01 GB, 2.17 GB, 2.34 GB, 2.51 GB, 2.69 GB, 2.88 GB, 3.08 GB, 3.28 GB, 3.48 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.69 GB (3957793917) - TotalGetBatchTime: 5m16s - DataArrivalTimer: 5m12s SenderSide: - DeserializeRowBatchTime: 2m2s - NumBatchesAccepted: 5.72K (5719) - NumBatchesDeferred: 29 (29) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 215.478ms - CumulativeAllocationBytes: 104.00 MB (109051904) - CumulativeAllocations: 52 (52) - PeakReservation: 104.00 MB (109051904) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.00 MB (109051904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000b8 (host=vc1510.foo.com:22000):(Total: 160.480ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(16s000ms): 17.94 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 19.89 MB, 24.02 MB, 92.95 MB, 97.64 MB, 100.43 MB, 132.44 MB, 255.55 MB, 484.88 MB, 774.11 MB, 1.07 GB, 1.40 GB, 1.71 GB, 1.96 GB, 2.18 GB, 2.42 GB, 2.67 GB, 2.93 GB, 3.16 GB, 3.41 GB, 3.66 GB, 3.92 GB, 4.20 GB, 4.48 GB, 4.79 GB, 5.09 GB, 5.39 GB ThreadUsage(16s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.70 GB (6118023124) - PeakReservation: 101.88 MB (106823680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.81 GB (6234395333) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 9m45s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 160.423ms - ExecTreePrepareTime: 11.047ms KrpcDataStreamSender (dst_id=26):(Total: 60.774ms, non-child: 60.774ms, % non-child: 100.00%) - BytesSent: 0 - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.92 MB (2015168) - RowsReturned: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 920.399ms, non-child: 920.399ms, % non-child: 100.00%) - CodegenTime: 3.669ms - CompileTime: 268.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 174 (174) - NumInstructions: 8.48K (8476) - OptimizationTime: 583.715ms - PeakMemoryUsage: 4.14 MB (4339712) - PrepareTime: 66.243ms AGGREGATION_NODE (id=15):(Total: 11.046ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 21.670ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.50K (1500) - BuildTime: 892.976us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 30.448us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 267.996us - BuildRowsPartitioned: 1.50K (1500) - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - HashTablesBuildTime: 498.462us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=25):(Total: 4s604ms, non-child: 44.593us, % non-child: 0.00%) - ConvertRowBatchTime: 28.286us - PeakMemoryUsage: 0 - RowsReturned: 1.50K (1500) - RowsReturnedRate: 325.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 64.91 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB, 95.10 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 95.10 KB (97384) - TotalGetBatchTime: 4s604ms - DataArrivalTimer: 4s604ms SenderSide: - DeserializeRowBatchTime: 305.623us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=13):(Total: 21.074ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 1.10K (1096) - BuildTime: 3.583ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2124032) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 2.651ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=13): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 423.745us - BuildRowsPartitioned: 1.10K (1096) - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.861ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=24):(Total: 1s164ms, non-child: 43.759us, % non-child: 0.00%) - ConvertRowBatchTime: 28.901us - PeakMemoryUsage: 0 - RowsReturned: 1.10K (1096) - RowsReturnedRate: 940.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 17.00 KB, 17.00 KB, 17.00 KB, 17.00 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB, 18.20 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 18.20 KB (18632) - TotalGetBatchTime: 1s164ms - DataArrivalTimer: 1s164ms SenderSide: - DeserializeRowBatchTime: 47.887us - NumBatchesAccepted: 2 (2) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=12):(Total: 4m22s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 293.34K (293341) - BuildTime: 416.912ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 98.13 MB (102895872) - ProbeRows: 120.25M (120247296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 18s632ms - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 343.234ms - BuildRowsPartitioned: 293.34K (293341) - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.014ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.12 KB (63616) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 4m22s, non-child: 65.700ms, % non-child: 0.03%) - ConvertRowBatchTime: 10.381ms - PeakMemoryUsage: 0 - RowsReturned: 293.34K (293341) - RowsReturnedRate: 1.12 K/sec RecvrSide: BytesReceived(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.22 MB, 37.32 MB, 41.07 MB, 41.07 MB, 41.07 MB, 41.07 MB, 48.14 MB, 69.57 MB - FirstBatchArrivalWaitTime: 3m21s - TotalBytesReceived: 80.05 MB (83942330) - TotalGetBatchTime: 4m21s - DataArrivalTimer: 4m21s SenderSide: - DeserializeRowBatchTime: 458.491ms - NumBatchesAccepted: 74 (74) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=22):(Total: 5m21s, non-child: 5s880ms, % non-child: 1.83%) - ConvertRowBatchTime: 2s942ms - PeakMemoryUsage: 0 - RowsReturned: 120.25M (120247714) - RowsReturnedRate: 374.60 K/sec RecvrSide: BytesReceived(16s000ms): 8.95 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 9.90 MB, 17.55 MB, 101.41 MB, 253.83 MB, 444.99 MB, 658.70 MB, 882.34 MB, 1.07 GB, 1.23 GB, 1.38 GB, 1.53 GB, 1.70 GB, 1.87 GB, 2.02 GB, 2.19 GB, 2.35 GB, 2.52 GB, 2.71 GB, 2.89 GB, 3.10 GB, 3.29 GB, 3.50 GB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 3.70 GB (3968866605) - TotalGetBatchTime: 5m18s - DataArrivalTimer: 5m15s SenderSide: - DeserializeRowBatchTime: 1m31s - NumBatchesAccepted: 5.74K (5735) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 99.866ms - CumulativeAllocationBytes: 98.00 MB (102760448) - CumulativeAllocations: 49 (49) - PeakReservation: 98.00 MB (102760448) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 98.00 MB (102760448) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Averaged Fragment F00:(Total: 34s561ms, non-child: 463.888ms, % non-child: 1.34%) split sizes: min: 27.89 GB, max: 27.98 GB, avg: 27.91 GB, stddev: 19.37 MB completion times: min:10m22s max:10m23s mean: 10m23s stddev:190.416ms execution rates: min:45.83 MB/sec max:45.99 MB/sec mean:45.87 MB/sec stddev:36.63 KB/sec num instances: 37 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 67.98 MB (71278040) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.81 GB (6241226944) - RowsProduced: 120.67M (120666831) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m39s - TotalStorageWaitTime: 2s835ms - TotalThreadsInvoluntaryContextSwitches: 589 (589) - TotalThreadsTotalWallClockTime: 33s710ms - TotalThreadsSysTime: 176.648ms - TotalThreadsUserTime: 2s264ms - TotalThreadsVoluntaryContextSwitches: 3.12K (3123) Fragment Instance Lifecycle Timings: - ExecTime: 33s511ms - ExecTreeExecTime: 13s855ms - OpenTime: 199.840ms - ExecTreeOpenTime: 1.521ms - PrepareTime: 850.961ms - ExecTreePrepareTime: 25.262ms KrpcDataStreamSender (dst_id=22):(Total: 19s926ms, non-child: 19s926ms, % non-child: 100.00%) - BytesSent: 1.95 GB (2092856881) - OverallThroughput: 100.35 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 120.67M (120666194) - RpcRetry: 0 (0) - SerializeBatchTime: 19s327ms - UncompressedRowBatchSize: 3.69 GB (3967164553) CodeGen:(Total: 418.665ms, non-child: 418.665ms, % non-child: 100.00%) - CodegenTime: 3.149ms - CompileTime: 45.936ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 141.205ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 215.741ms HDFS_SCAN_NODE (id=2):(Total: 13s752ms, non-child: 13s752ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.25 GB (1345358527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s688ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 311 (311) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 25.22 MB (26443558) - PerReadThreadRawHdfsThroughput: 568.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 180.33M (180328785) - RowsReturned: 120.67M (120667052) - RowsReturnedRate: 9.30 M/sec - ScanRangesComplete: 520 (520) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s568ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s259ms - TotalReadThroughput: 2.12 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 670 (670) - RowGroups processed: 116.52K (116519) - RowGroups rejected: 0 (0) - RowGroups total: 117.96K (117959) - Rows processed: 9.28M (9280390) - Rows rejected: 0 (0) - Rows total: 179.91M (179910605) - Splits processed: 517 (517) - Splits rejected: 209 (209) - Splits total: 521 (521) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.26M (9258852) - Rows rejected: 52.11K (52106) - Rows total: 179.91M (179910605) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 120.29M (120289239) - Rows rejected: 59.42M (59416565) - Rows total: 179.86M (179858499) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Fragment F00: Instance b04615c310d227c4:3270037300000002 (host=vc1538.foo.com:22000):(Total: 10m22s, non-child: 9m44s, % non-child: 93.91%) Hdfs split stats (:<# splits>/): 5:82/3.34 GB -1:9/443.64 MB 0:82/3.32 GB 3:77/3.20 GB 4:89/3.74 GB 1:89/3.17 GB 6:99/4.16 GB 7:78/3.05 GB 2:83/3.50 GB Filter 2 arrival: 6s594ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m40s MemoryUsage(16s000ms): 40.80 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 49.25 MB, 34.26 MB, 37.29 MB, 37.40 MB, 37.95 MB, 37.76 MB, 39.64 MB, 37.24 MB, 35.12 MB, 38.05 MB, 37.03 MB, 37.54 MB, 38.87 MB, 39.28 MB, 39.01 MB, 41.02 MB, 38.44 MB, 38.55 MB, 42.30 MB, 35.45 MB, 39.41 MB, 41.47 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.27 MB (71581072) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.00 GB (6445151402) - RowsProduced: 119.40M (119400532) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m8s - TotalStorageWaitTime: 3s533ms - TotalThreadsInvoluntaryContextSwitches: 12.02K (12022) - TotalThreadsTotalWallClockTime: 10m22s - TotalThreadsSysTime: 3s520ms - TotalThreadsUserTime: 45s268ms - TotalThreadsVoluntaryContextSwitches: 58.77K (58772) Fragment Instance Lifecycle Timings: - ExecTime: 10m22s - ExecTreeExecTime: 16s380ms - OpenTime: 227.704ms - ExecTreeOpenTime: 1.609ms - PrepareTime: 321.585ms - ExecTreePrepareTime: 5.929ms KrpcDataStreamSender (dst_id=22):(Total: 21s321ms, non-child: 21s321ms, % non-child: 100.00%) - BytesSent: 1.93 GB (2068703620) - OverallThroughput: 92.53 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 119.40M (119400532) - RpcRetry: 0 (0) - SerializeBatchTime: 21s165ms - UncompressedRowBatchSize: 3.65 GB (3920423595) CodeGen:(Total: 377.901ms, non-child: 377.901ms, % non-child: 100.00%) - CodegenTime: 2.569ms - CompileTime: 25.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 193.900ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 136.043ms HDFS_SCAN_NODE (id=2):(Total: 16s225ms, non-child: 16s225ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:82/3.34 GB -1:9/443.64 MB 0:82/3.32 GB 3:77/3.20 GB 4:89/3.74 GB 1:89/3.17 GB 6:99/4.16 GB 7:78/3.05 GB 2:83/3.50 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 502ms BytesRead(16s000ms): 11.89 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 14.48 MB, 26.25 MB, 63.95 MB, 119.24 MB, 167.87 MB, 244.40 MB, 323.07 MB, 378.48 MB, 424.73 MB, 476.00 MB, 532.56 MB, 586.20 MB, 627.64 MB, 672.45 MB, 728.79 MB, 790.49 MB, 852.27 MB, 922.37 MB, 1017.15 MB, 1.07 GB, 1.14 GB, 1.19 GB - FooterProcessingTime: (Avg: 3.521ms ; Min: 286.890us ; Max: 202.540ms ; Number of samples: 324) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.26 GB (1351684822) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 8s099ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 324 (324) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.09 MB (25257790) - PerReadThreadRawHdfsThroughput: 596.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 181.21M (181208628) - RowsReturned: 119.40M (119400532) - RowsReturnedRate: 7.36 M/sec - ScanRangesComplete: 542 (542) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 54s637ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s160ms - TotalReadThroughput: 2.08 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 688 (688) - RowGroups processed: 115.13K (115131) - RowGroups rejected: 0 (0) - RowGroups total: 116.76K (116761) - Rows processed: 10.08M (10075405) - Rows rejected: 0 (0) - Rows total: 180.81M (180811316) - Splits processed: 539 (539) - Splits rejected: 219 (219) - Splits total: 543 (543) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.05M (10046763) - Rows rejected: 57.11K (57113) - Rows total: 180.81M (180811316) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 123.88M (123876318) - Rows rejected: 61.63M (61627079) - Rows total: 180.75M (180754203) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000c (host=vc1542.foo.com:22000):(Total: 10m22s, non-child: 9m40s, % non-child: 93.35%) Hdfs split stats (:<# splits>/): 2:91/4.05 GB -1:8/330.66 MB 0:79/3.11 GB 1:82/3.06 GB 3:94/3.85 GB 5:67/2.81 GB 4:91/3.31 GB 7:66/2.94 GB 6:106/4.44 GB Filter 2 arrival: 6s070ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m40s MemoryUsage(16s000ms): 27.24 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 50.19 MB, 32.47 MB, 32.09 MB, 35.66 MB, 35.42 MB, 35.37 MB, 38.58 MB, 33.73 MB, 37.30 MB, 36.62 MB, 40.68 MB, 38.77 MB, 39.13 MB, 43.46 MB, 38.76 MB, 38.20 MB, 35.57 MB, 38.44 MB, 36.47 MB, 39.11 MB, 40.33 MB, 41.28 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 65.46 MB (68639631) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 6.00 GB (6442744165) - RowsProduced: 91.33M (91329103) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m36s - TotalStorageWaitTime: 3s675ms - TotalThreadsInvoluntaryContextSwitches: 9.22K (9225) - TotalThreadsTotalWallClockTime: 10m18s - TotalThreadsSysTime: 2s976ms - TotalThreadsUserTime: 35s290ms - TotalThreadsVoluntaryContextSwitches: 55.53K (55527) Fragment Instance Lifecycle Timings: - ExecTime: 10m17s - ExecTreeExecTime: 19s272ms - OpenTime: 415.131ms - ExecTreeOpenTime: 1.698ms - PrepareTime: 3s924ms - ExecTreePrepareTime: 50.889ms KrpcDataStreamSender (dst_id=22):(Total: 21s127ms, non-child: 21s127ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1581015209) - OverallThroughput: 71.36 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 91.33M (91329103) - RpcRetry: 0 (0) - SerializeBatchTime: 17s821ms - UncompressedRowBatchSize: 2.79 GB (2995854147) CodeGen:(Total: 973.281ms, non-child: 973.281ms, % non-child: 100.00%) - CodegenTime: 3.709ms - CompileTime: 92.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 296.377ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 545.554ms HDFS_SCAN_NODE (id=2):(Total: 19s246ms, non-child: 19s246ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:91/4.05 GB -1:8/330.66 MB 0:79/3.11 GB 1:82/3.06 GB 3:94/3.85 GB 5:67/2.81 GB 4:91/3.31 GB 7:66/2.94 GB 6:106/4.44 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 6.94 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 14.59 MB, 21.48 MB, 50.60 MB, 82.54 MB, 123.86 MB, 173.25 MB, 231.37 MB, 279.96 MB, 316.78 MB, 351.70 MB, 396.89 MB, 447.99 MB, 484.94 MB, 527.16 MB, 577.79 MB, 641.13 MB, 700.97 MB, 749.70 MB, 805.48 MB, 858.79 MB, 913.92 MB, 957.54 MB - FooterProcessingTime: (Avg: 5.597ms ; Min: 377.466us ; Max: 298.855ms ; Number of samples: 257) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1006.15 MB (1055027203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 10s000ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 257 (257) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.36 MB (25545540) - PerReadThreadRawHdfsThroughput: 522.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 138.97M (138971128) - RowsReturned: 91.33M (91329103) - RowsReturnedRate: 4.75 M/sec - ScanRangesComplete: 437 (437) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 46s164ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s924ms - TotalReadThroughput: 1.61 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 684 (684) - RowGroups processed: 88.97K (88965) - RowGroups rejected: 0 (0) - RowGroups total: 89.23K (89228) - Rows processed: 7.85M (7854316) - Rows rejected: 0 (0) - Rows total: 138.93M (138927096) - Splits processed: 437 (437) - Splits rejected: 181 (181) - Splits total: 438 (438) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 7.76M (7761114) - Rows rejected: 43.38K (43382) - Rows total: 138.93M (138927096) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 93.03M (93031903) - Rows rejected: 47.56M (47556659) - Rows total: 138.88M (138883714) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000021 (host=vc1509.foo.com:22000):(Total: 5s496ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:76/3.08 GB 1:78/3.00 GB 2:90/3.63 GB 4:76/3.36 GB 3:75/3.22 GB 5:74/3.21 GB 6:85/3.76 GB -1:12/374.78 MB 0:106/4.30 GB Filter 2 arrival: 5s836ms Filter 4 arrival: 4m35s Filter 5 arrival: 4m35s MemoryUsage(16s000ms): 25.83 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 50.90 MB, 36.19 MB, 40.87 MB, 44.79 MB, 36.50 MB, 38.69 MB, 40.23 MB, 37.60 MB, 35.86 MB, 40.77 MB, 42.89 MB, 34.94 MB, 37.77 MB, 39.20 MB, 35.78 MB, 42.00 MB, 41.09 MB, 39.06 MB, 39.16 MB, 39.69 MB, 37.17 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.24 MB (71553070) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.67 GB (6085819523) - RowsProduced: 110.25M (110245044) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m23s - TotalStorageWaitTime: 2s621ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 597.203ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 103.985ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s030ms - OpenTime: 597.207ms - ExecTreeOpenTime: 1.266ms - PrepareTime: 4s898ms - ExecTreePrepareTime: 22.761ms KrpcDataStreamSender (dst_id=22):(Total: 23s572ms, non-child: 23s572ms, % non-child: 100.00%) - BytesSent: 1.79 GB (1917168100) - OverallThroughput: 77.56 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 110.24M (110244020) - RpcRetry: 0 (0) - SerializeBatchTime: 19s732ms - UncompressedRowBatchSize: 3.38 GB (3633225750) CodeGen:(Total: 1s615ms, non-child: 1s615ms, % non-child: 100.00%) - CodegenTime: 2.977ms - CompileTime: 88.101ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 418.140ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 1s058ms HDFS_SCAN_NODE (id=2):(Total: 13s921ms, non-child: 13s921ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:76/3.08 GB 1:78/3.00 GB 2:90/3.63 GB 4:76/3.36 GB 3:75/3.22 GB 5:74/3.21 GB 6:85/3.76 GB -1:12/374.78 MB 0:106/4.30 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 61ms BytesRead(16s000ms): 6.79 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 31.01 MB, 92.10 MB, 148.93 MB, 223.61 MB, 295.87 MB, 378.40 MB, 437.17 MB, 487.84 MB, 536.83 MB, 581.61 MB, 631.46 MB, 671.83 MB, 713.44 MB, 765.33 MB, 829.96 MB, 887.46 MB, 949.08 MB, 1009.09 MB, 1.05 GB, 1.11 GB - FooterProcessingTime: (Avg: 2.381ms ; Min: 291.866us ; Max: 52.957ms ; Number of samples: 295) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.16 GB (1240273970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7s514ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 295 (295) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519820) - PerReadThreadRawHdfsThroughput: 557.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 165.92M (165919843) - RowsReturned: 110.25M (110245044) - RowsReturnedRate: 7.92 M/sec - ScanRangesComplete: 494 (494) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 48s250ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s121ms - TotalReadThroughput: 1.98 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 672 (672) - RowGroups processed: 107.79K (107794) - RowGroups rejected: 0 (0) - RowGroups total: 107.79K (107794) - Rows processed: 8.89M (8889065) - Rows rejected: 0 (0) - Rows total: 165.76M (165764195) - Splits processed: 494 (494) - Splits rejected: 200 (200) - Splits total: 495 (495) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.85M (8854383) - Rows rejected: 50.79K (50792) - Rows total: 165.76M (165764195) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 111.82M (111818616) - Rows rejected: 55.45M (55450881) - Rows total: 165.71M (165713403) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000023 (host=vc1507.foo.com:22000):(Total: 3s269ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:90/3.81 GB -1:11/398.86 MB 0:86/3.53 GB 3:79/3.09 GB 4:79/3.48 GB 1:75/3.10 GB 7:80/3.45 GB 6:83/3.51 GB 2:92/3.57 GB Filter 2 arrival: 4s873ms Filter 5 arrival: 4m34s Filter 4 arrival: 4m34s MemoryUsage(16s000ms): 35.12 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 51.72 MB, 37.05 MB, 37.16 MB, 35.67 MB, 37.42 MB, 40.00 MB, 39.82 MB, 35.96 MB, 41.19 MB, 35.62 MB, 36.96 MB, 40.29 MB, 38.86 MB, 38.01 MB, 42.17 MB, 41.82 MB, 37.93 MB, 40.47 MB, 37.79 MB, 39.72 MB, 41.14 MB, 37.45 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.93 MB (70179625) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.95 GB (6385975709) - RowsProduced: 130.91M (130910926) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m31s - TotalStorageWaitTime: 3s188ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 400.588ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 90.986ms - TotalThreadsVoluntaryContextSwitches: 50 (50) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 18s706ms - OpenTime: 400.591ms - ExecTreeOpenTime: 1.788ms - PrepareTime: 2s868ms - ExecTreePrepareTime: 12.795ms KrpcDataStreamSender (dst_id=22):(Total: 22s338ms, non-child: 22s338ms, % non-child: 100.00%) - BytesSent: 2.11 GB (2270901285) - OverallThroughput: 96.95 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 130.91M (130909902) - RpcRetry: 0 (0) - SerializeBatchTime: 20s545ms - UncompressedRowBatchSize: 4.01 GB (4302431331) CodeGen:(Total: 1s462ms, non-child: 1s462ms, % non-child: 100.00%) - CodegenTime: 3.190ms - CompileTime: 61.624ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 305.746ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 993.579ms HDFS_SCAN_NODE (id=2):(Total: 18s569ms, non-child: 18s569ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:90/3.81 GB -1:11/398.86 MB 0:86/3.53 GB 3:79/3.09 GB 4:79/3.48 GB 1:75/3.10 GB 7:80/3.45 GB 6:83/3.51 GB 2:92/3.57 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 8.99 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 13.85 MB, 29.96 MB, 98.32 MB, 173.47 MB, 266.99 MB, 368.25 MB, 466.45 MB, 542.88 MB, 585.93 MB, 643.21 MB, 695.48 MB, 764.60 MB, 826.37 MB, 899.66 MB, 958.30 MB, 1009.90 MB, 1.05 GB, 1.11 GB, 1.16 GB, 1.22 GB, 1.29 GB, 1.33 GB - FooterProcessingTime: (Avg: 3.126ms ; Min: 253.434us ; Max: 120.663ms ; Number of samples: 352) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.39 GB (1496685901) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s753ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 352 (352) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519892) - PerReadThreadRawHdfsThroughput: 571.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 200.74M (200741979) - RowsReturned: 130.91M (130910926) - RowsReturnedRate: 7.05 M/sec - ScanRangesComplete: 565 (565) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 59s927ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s499ms - TotalReadThroughput: 2.32 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 675 (675) - RowGroups processed: 127.54K (127538) - RowGroups rejected: 0 (0) - RowGroups total: 127.98K (127980) - Rows processed: 10.57M (10572922) - Rows rejected: 0 (0) - Rows total: 199.69M (199690331) - Splits processed: 564 (564) - Splits rejected: 214 (214) - Splits total: 566 (566) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.55M (10550481) - Rows rejected: 59.42K (59420) - Rows total: 199.69M (199690331) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 139.34M (139342791) - Rows rejected: 68.95M (68947313) - Rows total: 199.63M (199630911) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000e (host=vc1534.foo.com:22000):(Total: 2s433ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:68/2.83 GB -1:16/631.56 MB 0:82/3.21 GB 1:85/3.36 GB 3:82/3.42 GB 7:82/3.23 GB 4:87/3.68 GB 2:86/3.54 GB 5:91/4.02 GB Filter 2 arrival: 5s190ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m38s MemoryUsage(16s000ms): 38.54 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 47.00 MB, 33.76 MB, 36.74 MB, 32.83 MB, 38.25 MB, 39.97 MB, 43.52 MB, 36.95 MB, 40.20 MB, 38.68 MB, 37.09 MB, 39.57 MB, 39.95 MB, 38.22 MB, 39.80 MB, 35.82 MB, 42.04 MB, 36.51 MB, 41.87 MB, 42.96 MB, 44.78 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.95 MB (70199208) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.75 GB (6171285594) - RowsProduced: 124.70M (124695856) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m30s - TotalStorageWaitTime: 3s023ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 192.719ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 94.986ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15s160ms - OpenTime: 192.722ms - ExecTreeOpenTime: 1.437ms - PrepareTime: 2s240ms - ExecTreePrepareTime: 61.088ms KrpcDataStreamSender (dst_id=22):(Total: 21s548ms, non-child: 21s548ms, % non-child: 100.00%) - BytesSent: 2.01 GB (2161204007) - OverallThroughput: 95.65 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 124.70M (124695856) - RpcRetry: 0 (0) - SerializeBatchTime: 19s675ms - UncompressedRowBatchSize: 3.82 GB (4096894560) CodeGen:(Total: 490.136ms, non-child: 490.136ms, % non-child: 100.00%) - CodegenTime: 2.631ms - CompileTime: 52.029ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 129.390ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 289.493ms HDFS_SCAN_NODE (id=2):(Total: 15s120ms, non-child: 15s120ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:68/2.83 GB -1:16/631.56 MB 0:82/3.21 GB 1:85/3.36 GB 3:82/3.42 GB 7:82/3.23 GB 4:87/3.68 GB 2:86/3.54 GB 5:91/4.02 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 17.54 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 22.41 MB, 37.78 MB, 87.49 MB, 146.09 MB, 223.15 MB, 299.03 MB, 372.35 MB, 412.94 MB, 473.34 MB, 521.76 MB, 576.05 MB, 629.19 MB, 694.37 MB, 768.02 MB, 825.44 MB, 894.57 MB, 972.22 MB, 1.02 GB, 1.09 GB, 1.17 GB, 1.25 GB - FooterProcessingTime: (Avg: 1.813ms ; Min: 248.452us ; Max: 43.591ms ; Number of samples: 329) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.31 GB (1408273660) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s922ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 329 (329) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 25.55 MB (26788377) - PerReadThreadRawHdfsThroughput: 561.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 186.25M (186253842) - RowsReturned: 124.70M (124695856) - RowsReturnedRate: 8.25 M/sec - ScanRangesComplete: 555 (555) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 44s751ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s391ms - TotalReadThroughput: 2.23 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 679 (679) - RowGroups processed: 120.99K (120994) - RowGroups rejected: 1 (1) - RowGroups total: 121.88K (121875) - Rows processed: 9.93M (9926163) - Rows rejected: 0 (0) - Rows total: 185.24M (185235986) - Splits processed: 555 (555) - Splits rejected: 227 (227) - Splits total: 556 (556) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.83M (9827859) - Rows rejected: 54.41K (54409) - Rows total: 185.24M (185235986) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 123.97M (123969301) - Rows rejected: 61.10M (61101145) - Rows total: 185.18M (185181577) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001a (host=vc1523.foo.com:22000):(Total: 1s974ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:72/3.11 GB 6:81/3.10 GB 4:76/3.33 GB 1:84/3.71 GB -1:11/703.80 MB 0:87/3.72 GB 7:71/3.06 GB 5:95/3.41 GB 3:88/3.83 GB Filter 2 arrival: 4s995ms Filter 5 arrival: 4m36s Filter 4 arrival: 4m36s MemoryUsage(16s000ms): 37.68 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 49.69 MB, 47.99 MB, 36.29 MB, 36.25 MB, 34.60 MB, 39.30 MB, 39.72 MB, 38.62 MB, 37.93 MB, 37.98 MB, 37.85 MB, 40.22 MB, 42.68 MB, 39.66 MB, 37.65 MB, 36.01 MB, 37.46 MB, 40.57 MB, 43.15 MB, 43.06 MB, 39.30 MB, 35.85 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.85 MB (70098626) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.80 GB (6225362036) - RowsProduced: 106.11M (106112544) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m59s - TotalStorageWaitTime: 2s640ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 301.162ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 94.985ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15s640ms - OpenTime: 301.165ms - ExecTreeOpenTime: 1.192ms - PrepareTime: 1s672ms - ExecTreePrepareTime: 9.948ms KrpcDataStreamSender (dst_id=22):(Total: 19s366ms, non-child: 19s366ms, % non-child: 100.00%) - BytesSent: 1.71 GB (1837249424) - OverallThroughput: 90.47 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 106.11M (106111520) - RpcRetry: 0 (0) - SerializeBatchTime: 18s158ms - UncompressedRowBatchSize: 3.24 GB (3482360376) CodeGen:(Total: 754.685ms, non-child: 754.685ms, % non-child: 100.00%) - CodegenTime: 4.627ms - CompileTime: 111.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 185.072ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 407.108ms HDFS_SCAN_NODE (id=2):(Total: 15s504ms, non-child: 15s504ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:72/3.11 GB 6:81/3.10 GB 4:76/3.33 GB 1:84/3.71 GB -1:11/703.80 MB 0:87/3.72 GB 7:71/3.06 GB 5:95/3.41 GB 3:88/3.83 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 9.69 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 12.75 MB, 28.32 MB, 76.09 MB, 126.22 MB, 191.22 MB, 257.22 MB, 330.15 MB, 385.55 MB, 439.45 MB, 497.93 MB, 550.64 MB, 598.67 MB, 643.84 MB, 693.31 MB, 747.22 MB, 795.93 MB, 856.80 MB, 918.29 MB, 979.69 MB, 1.01 GB, 1.07 GB - FooterProcessingTime: (Avg: 2.246ms ; Min: 431.045us ; Max: 76.927ms ; Number of samples: 272) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.11 GB (1193709228) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7s830ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 272 (272) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.36 MB (25545527) - PerReadThreadRawHdfsThroughput: 518.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 160.51M (160514496) - RowsReturned: 106.11M (106112544) - RowsReturnedRate: 6.84 M/sec - ScanRangesComplete: 463 (463) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s821ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s196ms - TotalReadThroughput: 1.89 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 665 (665) - RowGroups processed: 102.87K (102870) - RowGroups rejected: 1 (1) - RowGroups total: 103.75K (103754) - Rows processed: 8.18M (8183182) - Rows rejected: 0 (0) - Rows total: 159.47M (159467968) - Splits processed: 463 (463) - Splits rejected: 192 (192) - Splits total: 464 (464) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.15M (8150414) - Rows rejected: 45.64K (45636) - Rows total: 159.47M (159467968) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 108.29M (108292346) - Rows rejected: 54.23M (54231388) - Rows total: 159.42M (159422332) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000011 (host=vc1524.foo.com:22000):(Total: 1s863ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:70/2.85 GB 2:90/4.07 GB 6:77/3.10 GB 4:82/3.40 GB 5:88/3.98 GB 7:73/2.72 GB -1:9/530.02 MB 0:89/3.43 GB 1:92/3.87 GB Filter 2 arrival: 5s874ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 43.43 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.28 MB, 36.08 MB, 37.22 MB, 39.87 MB, 38.37 MB, 41.37 MB, 37.24 MB, 38.05 MB, 41.53 MB, 40.16 MB, 38.56 MB, 38.86 MB, 37.04 MB, 43.15 MB, 42.57 MB, 40.42 MB, 40.02 MB, 40.73 MB, 38.91 MB, 38.01 MB, 40.73 MB, 36.63 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.64 MB (69877563) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.86 GB (6289587534) - RowsProduced: 127.22M (127219136) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m27s - TotalStorageWaitTime: 2s929ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 175.724ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 90.986ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13s039ms - OpenTime: 175.727ms - ExecTreeOpenTime: 1.079ms - PrepareTime: 1s688ms - ExecTreePrepareTime: 33.765ms KrpcDataStreamSender (dst_id=22):(Total: 20s414ms, non-child: 20s414ms, % non-child: 100.00%) - BytesSent: 2.05 GB (2205661119) - OverallThroughput: 103.04 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 127.22M (127218112) - RpcRetry: 0 (0) - SerializeBatchTime: 19s151ms - UncompressedRowBatchSize: 3.89 GB (4180631763) CodeGen:(Total: 553.536ms, non-child: 553.536ms, % non-child: 100.00%) - CodegenTime: 2.282ms - CompileTime: 32.338ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 121.334ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 383.463ms HDFS_SCAN_NODE (id=2):(Total: 12s963ms, non-child: 12s963ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:70/2.85 GB 2:90/4.07 GB 6:77/3.10 GB 4:82/3.40 GB 5:88/3.98 GB 7:73/2.72 GB -1:9/530.02 MB 0:89/3.43 GB 1:92/3.87 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 9.99 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 12.10 MB, 37.61 MB, 99.93 MB, 163.25 MB, 250.24 MB, 327.96 MB, 396.74 MB, 472.49 MB, 523.38 MB, 569.72 MB, 624.48 MB, 684.96 MB, 737.61 MB, 801.91 MB, 859.14 MB, 920.08 MB, 995.75 MB, 1.04 GB, 1.11 GB, 1.18 GB, 1.25 GB, 1.29 GB - FooterProcessingTime: (Avg: 2.759ms ; Min: 324.810us ; Max: 377.870ms ; Number of samples: 338) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.31 GB (1409457260) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s150ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 338 (338) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.60 MB (25795672) - PerReadThreadRawHdfsThroughput: 597.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 189.08M (189075242) - RowsReturned: 127.22M (127219136) - RowsReturnedRate: 9.81 M/sec - ScanRangesComplete: 561 (561) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 58s569ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s250ms - TotalReadThroughput: 2.21 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 670 (670) - RowGroups processed: 122.74K (122741) - RowGroups rejected: 0 (0) - RowGroups total: 124.37K (124369) - Rows processed: 10.01M (10012825) - Rows rejected: 0 (0) - Rows total: 188.51M (188514090) - Splits processed: 559 (559) - Splits rejected: 224 (224) - Splits total: 562 (562) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.95M (9952593) - Rows rejected: 54.95K (54946) - Rows total: 188.51M (188514090) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 126.23M (126229273) - Rows rejected: 61.68M (61676232) - Rows total: 188.46M (188459144) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000d (host=vc1532.foo.com:22000):(Total: 1s822ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:71/2.94 GB 4:86/3.52 GB 2:88/3.65 GB 6:69/3.10 GB -1:7/314.92 MB 0:82/3.41 GB 3:78/3.42 GB 5:96/3.90 GB 1:88/3.67 GB Filter 2 arrival: 6s223ms Filter 5 arrival: 4m38s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 42.31 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 48.69 MB, 47.02 MB, 35.22 MB, 41.80 MB, 42.32 MB, 36.85 MB, 36.80 MB, 35.75 MB, 37.51 MB, 41.06 MB, 39.66 MB, 40.22 MB, 39.55 MB, 39.52 MB, 44.69 MB, 40.75 MB, 43.30 MB, 41.41 MB, 41.92 MB, 40.55 MB, 40.21 MB, 39.12 MB, 39.61 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.38 MB (69604239) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.86 GB (6292176820) - RowsProduced: 140.28M (140277032) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m43s - TotalStorageWaitTime: 2s896ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 122.753ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 79.988ms - TotalThreadsVoluntaryContextSwitches: 32 (32) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8s906ms - OpenTime: 122.756ms - ExecTreeOpenTime: 1.555ms - PrepareTime: 1s699ms - ExecTreePrepareTime: 22.388ms KrpcDataStreamSender (dst_id=22):(Total: 21s993ms, non-child: 21s993ms, % non-child: 100.00%) - BytesSent: 2.26 GB (2431677984) - OverallThroughput: 105.44 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 140.28M (140276008) - RpcRetry: 0 (0) - SerializeBatchTime: 20s524ms - UncompressedRowBatchSize: 4.29 GB (4609698423) CodeGen:(Total: 240.714ms, non-child: 240.714ms, % non-child: 100.00%) - CodegenTime: 1.692ms - CompileTime: 24.357ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 92.366ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 115.669ms HDFS_SCAN_NODE (id=2):(Total: 8s793ms, non-child: 8s793ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:71/2.94 GB 4:86/3.52 GB 2:88/3.65 GB 6:69/3.10 GB -1:7/314.92 MB 0:82/3.41 GB 3:78/3.42 GB 5:96/3.90 GB 1:88/3.67 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 10.75 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 12.36 MB, 36.80 MB, 99.28 MB, 168.67 MB, 258.22 MB, 341.70 MB, 417.03 MB, 470.57 MB, 535.00 MB, 602.28 MB, 668.41 MB, 752.27 MB, 826.34 MB, 894.13 MB, 954.81 MB, 1.00 GB, 1.08 GB, 1.14 GB, 1.22 GB, 1.30 GB, 1.36 GB, 1.42 GB - FooterProcessingTime: (Avg: 2.431ms ; Min: 181.755us ; Max: 169.776ms ; Number of samples: 357) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.46 GB (1564394041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s890ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 357 (357) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 23.12 MB (24241470) - PerReadThreadRawHdfsThroughput: 635.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 210.56M (210555675) - RowsReturned: 140.28M (140277032) - RowsReturnedRate: 15.95 M/sec - ScanRangesComplete: 597 (597) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 48s893ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s349ms - TotalReadThroughput: 2.45 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 665 (665) - RowGroups processed: 135.51K (135506) - RowGroups rejected: 0 (0) - RowGroups total: 137.13K (137130) - Rows processed: 10.63M (10628997) - Rows rejected: 0 (0) - Rows total: 210.43M (210432795) - Splits processed: 594 (594) - Splits rejected: 241 (241) - Splits total: 598 (598) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.58M (10584116) - Rows rejected: 60.81K (60809) - Rows total: 210.43M (210432795) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 140.00M (139999227) - Rows rejected: 70.09M (70094951) - Rows total: 210.37M (210371986) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000b (host=vc1539.foo.com:22000):(Total: 1s456ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:80/3.50 GB 1:86/3.71 GB -1:13/540.87 MB 0:77/3.57 GB 2:92/3.73 GB 6:62/2.58 GB 5:67/2.96 GB 3:92/3.89 GB 7:84/3.44 GB Filter 2 arrival: 5s443ms Filter 5 arrival: 4m38s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 46.28 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 53.94 MB, 51.46 MB, 36.01 MB, 36.34 MB, 41.23 MB, 35.77 MB, 42.20 MB, 37.32 MB, 38.16 MB, 36.19 MB, 41.43 MB, 37.51 MB, 40.60 MB, 34.44 MB, 36.14 MB, 35.88 MB, 35.62 MB, 38.08 MB, 39.24 MB, 40.86 MB, 42.46 MB, 41.78 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 70.74 MB (74180446) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.79 GB (6211653933) - RowsProduced: 122.52M (122518284) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m28s - TotalStorageWaitTime: 2s281ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 257.743ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 122.981ms - TotalThreadsVoluntaryContextSwitches: 50 (50) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s727ms - OpenTime: 257.748ms - ExecTreeOpenTime: 1.736ms - PrepareTime: 1s198ms - ExecTreePrepareTime: 4.001ms KrpcDataStreamSender (dst_id=22):(Total: 20s245ms, non-child: 20s245ms, % non-child: 100.00%) - BytesSent: 1.98 GB (2123296087) - OverallThroughput: 100.02 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 122.52M (122517260) - RpcRetry: 0 (0) - SerializeBatchTime: 19s223ms - UncompressedRowBatchSize: 3.75 GB (4022845959) CodeGen:(Total: 430.589ms, non-child: 430.589ms, % non-child: 100.00%) - CodegenTime: 2.509ms - CompileTime: 76.575ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 172.531ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 166.887ms HDFS_SCAN_NODE (id=2):(Total: 14s567ms, non-child: 14s567ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:80/3.50 GB 1:86/3.71 GB -1:13/540.87 MB 0:77/3.57 GB 2:92/3.73 GB 6:62/2.58 GB 5:67/2.96 GB 3:92/3.89 GB 7:84/3.44 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 14.01 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 16.61 MB, 30.23 MB, 96.62 MB, 176.00 MB, 231.89 MB, 301.17 MB, 368.96 MB, 423.12 MB, 479.27 MB, 541.98 MB, 599.39 MB, 665.73 MB, 717.54 MB, 784.42 MB, 844.80 MB, 901.10 MB, 957.66 MB, 1.00 GB, 1.09 GB, 1.17 GB, 1.24 GB - FooterProcessingTime: (Avg: 1.828ms ; Min: 215.446us ; Max: 74.999ms ; Number of samples: 315) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.30 GB (1397767030) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7s278ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 315 (315) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.09 MB (29452111) - PerReadThreadRawHdfsThroughput: 583.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 188.20M (188204883) - RowsReturned: 122.52M (122518284) - RowsReturnedRate: 8.41 M/sec - ScanRangesComplete: 535 (535) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 52s740ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s284ms - TotalReadThroughput: 2.21 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 653 (653) - RowGroups processed: 118.16K (118164) - RowGroups rejected: 0 (0) - RowGroups total: 119.79K (119791) - Rows processed: 9.72M (9717891) - Rows rejected: 0 (0) - Rows total: 187.71M (187706195) - Splits processed: 532 (532) - Splits rejected: 221 (221) - Splits total: 536 (536) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.74M (9738726) - Rows rejected: 54.66K (54664) - Rows total: 187.71M (187706195) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 132.17M (132168300) - Rows rejected: 65.34M (65341119) - Rows total: 187.65M (187651531) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000017 (host=vc1537.foo.com:22000):(Total: 1s221ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): -1:14/538.98 MB 0:74/2.99 GB 2:84/3.43 GB 4:84/3.59 GB 5:83/3.35 GB 3:86/3.43 GB 1:104/4.01 GB 7:86/3.51 GB 6:77/3.09 GB Filter 2 arrival: 6s050ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 40.04 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 52.39 MB, 51.34 MB, 36.38 MB, 34.74 MB, 37.51 MB, 33.79 MB, 34.86 MB, 35.65 MB, 35.60 MB, 41.33 MB, 38.29 MB, 39.36 MB, 40.76 MB, 37.62 MB, 38.99 MB, 38.49 MB, 45.11 MB, 40.80 MB, 40.51 MB, 35.46 MB, 36.50 MB, 39.74 MB, 38.16 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 65.43 MB (68606782) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.85 GB (6281528487) - RowsProduced: 87.57M (87565067) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m4s - TotalStorageWaitTime: 3s026ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 200.401ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 75.989ms - TotalThreadsVoluntaryContextSwitches: 42 (42) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 16s300ms - OpenTime: 200.405ms - ExecTreeOpenTime: 4.381ms - PrepareTime: 1s020ms - ExecTreePrepareTime: 63.942ms KrpcDataStreamSender (dst_id=22):(Total: 20s815ms, non-child: 20s815ms, % non-child: 100.00%) - BytesSent: 1.41 GB (1514369242) - OverallThroughput: 69.38 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 87.56M (87564043) - RpcRetry: 0 (0) - SerializeBatchTime: 20s101ms - UncompressedRowBatchSize: 2.67 GB (2869210278) CodeGen:(Total: 437.651ms, non-child: 437.651ms, % non-child: 100.00%) - CodegenTime: 3.197ms - CompileTime: 42.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 150.871ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 238.637ms HDFS_SCAN_NODE (id=2):(Total: 16s299ms, non-child: 16s299ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:14/538.98 MB 0:74/2.99 GB 2:84/3.43 GB 4:84/3.59 GB 5:83/3.35 GB 3:86/3.43 GB 1:104/4.01 GB 7:86/3.51 GB 6:77/3.09 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 11.40 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 15.36 MB, 21.00 MB, 49.31 MB, 84.38 MB, 119.92 MB, 176.98 MB, 243.05 MB, 283.63 MB, 320.19 MB, 364.07 MB, 408.24 MB, 453.63 MB, 487.73 MB, 522.59 MB, 570.82 MB, 612.63 MB, 659.08 MB, 706.85 MB, 750.82 MB, 805.64 MB, 867.87 MB, 919.37 MB - FooterProcessingTime: (Avg: 3.007ms ; Min: 381.931us ; Max: 62.632ms ; Number of samples: 234) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 941.26 MB (986984325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7s127ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 234 (234) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.11 MB (23186105) - PerReadThreadRawHdfsThroughput: 319.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 131.98M (131978287) - RowsReturned: 87.57M (87565067) - RowsReturnedRate: 5.37 M/sec - ScanRangesComplete: 382 (382) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 52s113ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s945ms - TotalReadThroughput: 1.55 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 692 (692) - RowGroups processed: 84.62K (84625) - RowGroups rejected: 0 (0) - RowGroups total: 85.65K (85650) - Rows processed: 7.17M (7171317) - Rows rejected: 0 (0) - Rows total: 131.71M (131708975) - Splits processed: 380 (380) - Splits rejected: 149 (149) - Splits total: 383 (383) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 7.16M (7163217) - Rows rejected: 40.32K (40322) - Rows total: 131.71M (131708975) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 91.17M (91170214) - Rows rejected: 44.25M (44247970) - Rows total: 131.67M (131668653) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000001 (host=vc1515.foo.com:22000):(Total: 1s150ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:94/3.77 GB 3:83/3.37 GB 6:65/2.77 GB 1:83/3.44 GB 4:97/4.18 GB -1:12/571.72 MB 0:79/3.05 GB 5:83/3.40 GB 7:78/3.36 GB Filter 2 arrival: 5s995ms Filter 5 arrival: 4m35s Filter 4 arrival: 4m36s MemoryUsage(16s000ms): 41.75 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.33 MB, 35.64 MB, 29.99 MB, 35.53 MB, 35.58 MB, 35.32 MB, 40.37 MB, 32.44 MB, 36.98 MB, 39.77 MB, 34.67 MB, 42.87 MB, 40.33 MB, 39.66 MB, 37.71 MB, 38.19 MB, 39.24 MB, 40.64 MB, 39.74 MB, 38.10 MB, 38.72 MB, 36.85 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 72.40 MB (75921177) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.94 GB (6373464877) - RowsProduced: 90.75M (90749523) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m46s - TotalStorageWaitTime: 1s904ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 197.144ms - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 94.985ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15s480ms - OpenTime: 197.153ms - ExecTreeOpenTime: 1.189ms - PrepareTime: 953.333ms - ExecTreePrepareTime: 4.121ms KrpcDataStreamSender (dst_id=22):(Total: 18s931ms, non-child: 18s931ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1570083482) - OverallThroughput: 79.09 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 90.75M (90748499) - RpcRetry: 0 (0) - SerializeBatchTime: 18s294ms - UncompressedRowBatchSize: 2.77 GB (2977168986) CodeGen:(Total: 500.036ms, non-child: 500.036ms, % non-child: 100.00%) - CodegenTime: 3.371ms - CompileTime: 52.893ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 132.604ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 284.718ms HDFS_SCAN_NODE (id=2):(Total: 15s357ms, non-child: 15s357ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:94/3.77 GB 3:83/3.37 GB 6:65/2.77 GB 1:83/3.44 GB 4:97/4.18 GB -1:12/571.72 MB 0:79/3.05 GB 5:83/3.40 GB 7:78/3.36 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 10.76 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 14.01 MB, 21.11 MB, 41.45 MB, 84.37 MB, 121.62 MB, 169.61 MB, 215.39 MB, 249.95 MB, 282.24 MB, 310.66 MB, 343.50 MB, 403.55 MB, 453.57 MB, 489.90 MB, 543.80 MB, 593.00 MB, 647.73 MB, 696.53 MB, 746.20 MB, 815.75 MB, 873.13 MB, 912.20 MB - FooterProcessingTime: (Avg: 2.283ms ; Min: 257.004us ; Max: 71.034ms ; Number of samples: 232) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 948.99 MB (995085522) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 8s884ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 232 (232) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.10 MB (29460108) - PerReadThreadRawHdfsThroughput: 488.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 132.69M (132689056) - RowsReturned: 90.75M (90749523) - RowsReturnedRate: 5.91 M/sec - ScanRangesComplete: 381 (381) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 51s510ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s943ms - TotalReadThroughput: 1.54 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 674 (674) - RowGroups processed: 87.78K (87778) - RowGroups rejected: 0 (0) - RowGroups total: 88.74K (88740) - Rows processed: 6.68M (6684469) - Rows rejected: 0 (0) - Rows total: 132.31M (132306080) - Splits processed: 379 (379) - Splits rejected: 150 (150) - Splits total: 382 (382) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 6.66M (6657877) - Rows rejected: 37.45K (37450) - Rows total: 132.31M (132306080) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 82.84M (82844381) - Rows rejected: 41.78M (41777155) - Rows total: 132.27M (132268630) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000004 (host=vc1504.foo.com:22000):(Total: 1s100ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:74/3.42 GB -1:13/508.60 MB 0:79/3.10 GB 1:92/3.77 GB 6:83/3.39 GB 7:83/3.38 GB 5:95/3.86 GB 4:70/2.82 GB 2:86/3.66 GB Filter 2 arrival: 4s562ms Filter 5 arrival: 4m34s Filter 4 arrival: 4m34s MemoryUsage(16s000ms): 48.49 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 53.90 MB, 52.57 MB, 34.93 MB, 41.98 MB, 36.42 MB, 38.90 MB, 41.01 MB, 41.39 MB, 33.03 MB, 38.61 MB, 35.96 MB, 35.83 MB, 34.09 MB, 40.73 MB, 45.01 MB, 39.06 MB, 41.94 MB, 42.47 MB, 45.90 MB, 41.74 MB, 41.89 MB, 43.54 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.79 MB (70032210) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.79 GB (6212569592) - RowsProduced: 117.90M (117898220) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m1s - TotalStorageWaitTime: 2s559ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 145.809ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 92.986ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12s861ms - OpenTime: 145.812ms - ExecTreeOpenTime: 1.210ms - PrepareTime: 955.001ms - ExecTreePrepareTime: 108.403ms KrpcDataStreamSender (dst_id=22):(Total: 18s351ms, non-child: 18s351ms, % non-child: 100.00%) - BytesSent: 1.90 GB (2044178876) - OverallThroughput: 106.23 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 117.90M (117898220) - RpcRetry: 0 (0) - SerializeBatchTime: 17s807ms - UncompressedRowBatchSize: 3.61 GB (3874748757) CodeGen:(Total: 439.305ms, non-child: 439.305ms, % non-child: 100.00%) - CodegenTime: 3.834ms - CompileTime: 21.204ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 115.977ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 240.075ms HDFS_SCAN_NODE (id=2):(Total: 12s926ms, non-child: 12s926ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:74/3.42 GB -1:13/508.60 MB 0:79/3.10 GB 1:92/3.77 GB 6:83/3.39 GB 7:83/3.38 GB 5:95/3.86 GB 4:70/2.82 GB 2:86/3.66 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 61ms BytesRead(16s000ms): 10.83 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 11.89 MB, 35.96 MB, 83.70 MB, 147.43 MB, 217.23 MB, 273.65 MB, 339.56 MB, 389.18 MB, 436.51 MB, 486.69 MB, 557.84 MB, 617.18 MB, 669.76 MB, 730.15 MB, 790.14 MB, 849.25 MB, 915.77 MB, 969.29 MB, 1.03 GB, 1.11 GB, 1.18 GB - FooterProcessingTime: (Avg: 2.090ms ; Min: 350.236us ; Max: 60.103ms ; Number of samples: 300) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.25 GB (1338296002) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s910ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 300 (300) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519998) - PerReadThreadRawHdfsThroughput: 605.30 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 179.30M (179296759) - RowsReturned: 117.90M (117898220) - RowsReturnedRate: 9.12 M/sec - ScanRangesComplete: 503 (503) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 51s129ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s108ms - TotalReadThroughput: 2.11 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 675 (675) - RowGroups processed: 113.64K (113643) - RowGroups rejected: 0 (0) - RowGroups total: 115.26K (115264) - Rows processed: 8.85M (8852071) - Rows rejected: 0 (0) - Rows total: 179.25M (179254775) - Splits processed: 501 (501) - Splits rejected: 204 (204) - Splits total: 504 (504) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.85M (8845927) - Rows rejected: 50.69K (50689) - Rows total: 179.25M (179254775) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 120.44M (120437368) - Rows rejected: 61.23M (61225730) - Rows total: 179.20M (179204086) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000016 (host=vc1536.foo.com:22000):(Total: 1s038ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:75/3.21 GB 3:84/3.38 GB 5:83/3.25 GB 6:73/3.09 GB 2:96/4.01 GB 4:88/3.37 GB 1:69/3.10 GB -1:11/397.50 MB 0:94/4.11 GB Filter 2 arrival: 6s178ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 45.76 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 51.39 MB, 34.80 MB, 37.93 MB, 33.42 MB, 35.55 MB, 39.34 MB, 37.14 MB, 37.59 MB, 41.88 MB, 38.04 MB, 37.39 MB, 36.59 MB, 36.74 MB, 38.90 MB, 36.94 MB, 33.31 MB, 36.40 MB, 38.66 MB, 39.18 MB, 38.40 MB, 39.07 MB, 40.89 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.59 MB (69829574) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.91 GB (6342799709) - RowsProduced: 101.92M (101915124) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m3s - TotalStorageWaitTime: 2s429ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 289.993ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 111.983ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12s773ms - OpenTime: 289.997ms - ExecTreeOpenTime: 1.883ms - PrepareTime: 748.887ms - ExecTreePrepareTime: 38.467ms KrpcDataStreamSender (dst_id=22):(Total: 17s645ms, non-child: 17s645ms, % non-child: 100.00%) - BytesSent: 1.65 GB (1769910279) - OverallThroughput: 95.65 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 101.91M (101914100) - RpcRetry: 0 (0) - SerializeBatchTime: 17s115ms - UncompressedRowBatchSize: 3.12 GB (3354332421) CodeGen:(Total: 463.371ms, non-child: 463.371ms, % non-child: 100.00%) - CodegenTime: 4.363ms - CompileTime: 96.299ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 172.124ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 177.248ms HDFS_SCAN_NODE (id=2):(Total: 12s710ms, non-child: 12s710ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:75/3.21 GB 3:84/3.38 GB 5:83/3.25 GB 6:73/3.09 GB 2:96/4.01 GB 4:88/3.37 GB 1:69/3.10 GB -1:11/397.50 MB 0:94/4.11 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 60ms BytesRead(16s000ms): 12.74 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 14.97 MB, 23.48 MB, 61.82 MB, 107.09 MB, 165.26 MB, 230.17 MB, 297.90 MB, 358.40 MB, 405.21 MB, 462.75 MB, 521.36 MB, 558.16 MB, 591.23 MB, 635.70 MB, 685.81 MB, 733.68 MB, 788.89 MB, 840.08 MB, 903.74 MB, 957.45 MB, 1.00 GB, 1.04 GB - FooterProcessingTime: (Avg: 3.615ms ; Min: 299.228us ; Max: 225.233ms ; Number of samples: 258) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.06 GB (1140727250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7s668ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 258 (258) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.15 MB (25324371) - PerReadThreadRawHdfsThroughput: 513.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 153.14M (153139545) - RowsReturned: 101.92M (101915124) - RowsReturnedRate: 8.02 M/sec - ScanRangesComplete: 437 (437) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s167ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s117ms - TotalReadThroughput: 1.77 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 673 (673) - RowGroups processed: 98.03K (98029) - RowGroups rejected: 0 (0) - RowGroups total: 99.66K (99656) - Rows processed: 7.69M (7687948) - Rows rejected: 0 (0) - Rows total: 151.79M (151789913) - Splits processed: 434 (434) - Splits rejected: 180 (180) - Splits total: 438 (438) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 7.68M (7675130) - Rows rejected: 42.18K (42179) - Rows total: 151.79M (151789913) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 102.47M (102471982) - Rows rejected: 50.61M (50607778) - Rows total: 151.75M (151747734) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000019 (host=vc1517.foo.com:22000):(Total: 1s038ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:75/2.96 GB 3:101/3.96 GB -1:7/314.22 MB 0:81/3.24 GB 5:74/3.18 GB 4:99/3.81 GB 6:98/3.96 GB 1:80/3.47 GB 2:70/3.01 GB Filter 2 arrival: 6s080ms Filter 5 arrival: 4m36s Filter 4 arrival: 4m36s MemoryUsage(16s000ms): 44.34 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 50.97 MB, 49.17 MB, 36.32 MB, 37.97 MB, 44.76 MB, 39.65 MB, 40.20 MB, 37.12 MB, 37.29 MB, 37.39 MB, 37.17 MB, 37.64 MB, 39.84 MB, 39.24 MB, 38.54 MB, 43.43 MB, 39.65 MB, 40.70 MB, 41.30 MB, 39.91 MB, 40.04 MB, 40.34 MB, 44.39 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.90 MB (70154023) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.98 GB (6422770884) - RowsProduced: 116.43M (116428552) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m42s - TotalStorageWaitTime: 3s509ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 174.035ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 94.986ms - TotalThreadsVoluntaryContextSwitches: 28 (28) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s193ms - OpenTime: 174.039ms - ExecTreeOpenTime: 1.394ms - PrepareTime: 864.805ms - ExecTreePrepareTime: 179.908ms KrpcDataStreamSender (dst_id=22):(Total: 18s936ms, non-child: 18s936ms, % non-child: 100.00%) - BytesSent: 1.88 GB (2023469682) - OverallThroughput: 101.90 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 116.43M (116428552) - RpcRetry: 0 (0) - SerializeBatchTime: 18s412ms - UncompressedRowBatchSize: 3.57 GB (3834610263) CodeGen:(Total: 333.078ms, non-child: 333.078ms, % non-child: 100.00%) - CodegenTime: 4.654ms - CompileTime: 45.417ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 122.594ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 158.215ms HDFS_SCAN_NODE (id=2):(Total: 14s396ms, non-child: 14s396ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:75/2.96 GB 3:101/3.96 GB -1:7/314.22 MB 0:81/3.24 GB 5:74/3.18 GB 4:99/3.81 GB 6:98/3.96 GB 1:80/3.47 GB 2:70/3.01 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 61ms BytesRead(16s000ms): 11.00 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 12.70 MB, 40.06 MB, 104.09 MB, 175.12 MB, 246.79 MB, 331.91 MB, 399.93 MB, 450.10 MB, 487.17 MB, 525.74 MB, 568.49 MB, 616.06 MB, 675.25 MB, 728.61 MB, 776.42 MB, 824.69 MB, 879.51 MB, 934.69 MB, 1005.86 MB, 1.04 GB, 1.10 GB, 1.16 GB - FooterProcessingTime: (Avg: 4.565ms ; Min: 326.637us ; Max: 303.032ms ; Number of samples: 311) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.23 GB (1320799448) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s632ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 311 (311) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.11 MB (23186209) - PerReadThreadRawHdfsThroughput: 591.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 177.39M (177393068) - RowsReturned: 116.43M (116428552) - RowsReturnedRate: 8.09 M/sec - ScanRangesComplete: 514 (514) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 54s592ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s129ms - TotalReadThroughput: 2.04 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 685 (685) - RowGroups processed: 112.17K (112172) - RowGroups rejected: 0 (0) - RowGroups total: 113.80K (113802) - Rows processed: 9.40M (9402880) - Rows rejected: 0 (0) - Rows total: 177.39M (177393068) - Splits processed: 512 (512) - Splits rejected: 204 (204) - Splits total: 515 (515) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.37M (9374902) - Rows rejected: 52.89K (52892) - Rows total: 177.39M (177393068) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 122.07M (122067046) - Rows rejected: 60.83M (60826372) - Rows total: 177.34M (177340176) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000009 (host=vc1516.foo.com:22000):(Total: 656.897ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:84/3.86 GB 7:88/3.56 GB 1:82/3.57 GB -1:18/548.66 MB 0:74/3.10 GB 4:90/3.57 GB 3:80/3.01 GB 6:92/3.88 GB 2:65/2.81 GB Filter 2 arrival: 6s224ms Filter 5 arrival: 4m36s Filter 4 arrival: 4m36s MemoryUsage(16s000ms): 41.87 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 46.65 MB, 35.80 MB, 34.41 MB, 34.79 MB, 38.22 MB, 38.01 MB, 35.56 MB, 42.16 MB, 38.70 MB, 38.32 MB, 39.62 MB, 37.06 MB, 40.22 MB, 37.21 MB, 40.01 MB, 42.40 MB, 39.70 MB, 41.67 MB, 41.11 MB, 39.38 MB, 35.81 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 64.46 MB (67591974) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.78 GB (6206098639) - RowsProduced: 95.25M (95252745) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m36s - TotalStorageWaitTime: 2s343ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 197.508ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 89.986ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11s054ms - OpenTime: 197.511ms - ExecTreeOpenTime: 1.256ms - PrepareTime: 459.322ms - ExecTreePrepareTime: 19.453ms KrpcDataStreamSender (dst_id=22):(Total: 16s669ms, non-child: 16s669ms, % non-child: 100.00%) - BytesSent: 1.54 GB (1648739095) - OverallThroughput: 94.33 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 95.25M (95252745) - RpcRetry: 0 (0) - SerializeBatchTime: 16s440ms - UncompressedRowBatchSize: 2.91 GB (3123882102) CodeGen:(Total: 405.522ms, non-child: 405.522ms, % non-child: 100.00%) - CodegenTime: 3.474ms - CompileTime: 18.773ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 168.523ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 213.118ms HDFS_SCAN_NODE (id=2):(Total: 10s971ms, non-child: 10s971ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:84/3.86 GB 7:88/3.56 GB 1:82/3.57 GB -1:18/548.66 MB 0:74/3.10 GB 4:90/3.57 GB 3:80/3.01 GB 6:92/3.88 GB 2:65/2.81 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 402ms BytesRead(16s000ms): 10.67 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 11.91 MB, 24.16 MB, 54.68 MB, 89.78 MB, 131.71 MB, 184.92 MB, 245.82 MB, 300.70 MB, 332.35 MB, 377.08 MB, 426.73 MB, 481.43 MB, 530.64 MB, 576.98 MB, 624.95 MB, 662.43 MB, 715.11 MB, 775.36 MB, 843.95 MB, 905.16 MB, 965.13 MB - FooterProcessingTime: (Avg: 3.059ms ; Min: 255.668us ; Max: 98.249ms ; Number of samples: 250) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.01 GB (1081805491) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s940ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 250 (250) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.06 MB (23135159) - PerReadThreadRawHdfsThroughput: 526.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 144.26M (144255671) - RowsReturned: 95.25M (95253769) - RowsReturnedRate: 8.68 M/sec - ScanRangesComplete: 399 (399) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 40s627ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s960ms - TotalReadThroughput: 1.69 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 673 (673) - RowGroups processed: 91.50K (91497) - RowGroups rejected: 1 (1) - RowGroups total: 93.13K (93127) - Rows processed: 7.46M (7457547) - Rows rejected: 0 (0) - Rows total: 144.25M (144245431) - Splits processed: 397 (397) - Splits rejected: 150 (150) - Splits total: 400 (400) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 7.45M (7453451) - Rows rejected: 40.80K (40805) - Rows total: 144.25M (144245431) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 101.43M (101431521) - Rows rejected: 48.86M (48859009) - Rows total: 144.20M (144204626) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000024 (host=vc1535.foo.com:22000):(Total: 618.380ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:65/2.87 GB -1:11/448.28 MB 0:84/3.52 GB 5:102/4.35 GB 4:81/3.16 GB 1:84/3.63 GB 2:89/3.60 GB 3:71/3.17 GB 6:77/3.17 GB Filter 2 arrival: 6s311ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 44.52 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 51.02 MB, 32.20 MB, 39.90 MB, 35.35 MB, 37.77 MB, 35.83 MB, 38.08 MB, 38.09 MB, 42.07 MB, 39.23 MB, 38.65 MB, 37.52 MB, 39.83 MB, 38.00 MB, 41.17 MB, 41.92 MB, 39.50 MB, 39.08 MB, 40.51 MB, 39.52 MB, 40.36 MB, 41.72 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 67.47 MB (70748993) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.89 GB (6328346307) - RowsProduced: 104.74M (104742541) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m7s - TotalStorageWaitTime: 2s746ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 227.337ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 90.986ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 16s531ms - OpenTime: 227.339ms - ExecTreeOpenTime: 1.299ms - PrepareTime: 390.977ms - ExecTreePrepareTime: 11.548ms KrpcDataStreamSender (dst_id=22):(Total: 17s975ms, non-child: 17s975ms, % non-child: 100.00%) - BytesSent: 1.69 GB (1815209105) - OverallThroughput: 96.30 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 104.74M (104741517) - RpcRetry: 0 (0) - SerializeBatchTime: 17s763ms - UncompressedRowBatchSize: 3.20 GB (3440837796) CodeGen:(Total: 393.083ms, non-child: 393.083ms, % non-child: 100.00%) - CodegenTime: 1.733ms - CompileTime: 51.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 171.428ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 163.955ms HDFS_SCAN_NODE (id=2):(Total: 16s406ms, non-child: 16s406ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:65/2.87 GB -1:11/448.28 MB 0:84/3.52 GB 5:102/4.35 GB 4:81/3.16 GB 1:84/3.63 GB 2:89/3.60 GB 3:71/3.17 GB 6:77/3.17 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 441ms BytesRead(16s000ms): 12.86 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 15.18 MB, 25.26 MB, 65.72 MB, 126.33 MB, 186.07 MB, 255.47 MB, 323.84 MB, 366.07 MB, 404.57 MB, 453.87 MB, 502.46 MB, 555.29 MB, 597.63 MB, 640.82 MB, 684.95 MB, 735.79 MB, 787.20 MB, 844.24 MB, 898.43 MB, 959.68 MB, 1.01 GB, 1.07 GB - FooterProcessingTime: (Avg: 3.194ms ; Min: 379.547us ; Max: 190.093ms ; Number of samples: 271) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.09 GB (1172148189) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s081ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 271 (271) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.09 MB (29450007) - PerReadThreadRawHdfsThroughput: 545.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 157.30M (157297506) - RowsReturned: 104.74M (104742541) - RowsReturnedRate: 6.38 M/sec - ScanRangesComplete: 474 (474) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 1m - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s050ms - TotalReadThroughput: 1.83 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 664 (664) - RowGroups processed: 100.74K (100741) - RowGroups rejected: 0 (0) - RowGroups total: 102.37K (102367) - Rows processed: 8.02M (8018985) - Rows rejected: 0 (0) - Rows total: 157.30M (157297506) - Splits processed: 470 (470) - Splits rejected: 204 (204) - Splits total: 475 (475) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.01M (8005362) - Rows rejected: 45.23K (45225) - Rows total: 157.30M (157297506) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 105.72M (105717125) - Rows rejected: 52.44M (52441788) - Rows total: 157.25M (157252281) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000008 (host=vc1511.foo.com:22000):(Total: 601.024ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:86/3.67 GB 5:85/3.67 GB -1:10/417.77 MB 0:80/3.39 GB 7:69/2.70 GB 3:66/2.81 GB 4:96/3.99 GB 6:91/3.90 GB 2:80/3.37 GB Filter 2 arrival: 6s280ms Filter 4 arrival: 4m35s Filter 5 arrival: 4m35s MemoryUsage(16s000ms): 46.84 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 51.45 MB, 50.34 MB, 36.28 MB, 37.39 MB, 34.34 MB, 35.62 MB, 34.64 MB, 36.61 MB, 32.87 MB, 36.46 MB, 40.41 MB, 38.05 MB, 35.69 MB, 40.89 MB, 41.09 MB, 36.70 MB, 40.38 MB, 36.52 MB, 40.28 MB, 40.63 MB, 39.42 MB, 37.75 MB, 36.46 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 65.14 MB (68303165) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.82 GB (6245266545) - RowsProduced: 114.51M (114509707) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m29s - TotalStorageWaitTime: 2s796ms - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 214.397ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 96.985ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15s637ms - OpenTime: 214.401ms - ExecTreeOpenTime: 1.378ms - PrepareTime: 386.564ms - ExecTreePrepareTime: 14.665ms KrpcDataStreamSender (dst_id=22):(Total: 17s923ms, non-child: 17s923ms, % non-child: 100.00%) - BytesSent: 1.85 GB (1986018566) - OverallThroughput: 105.67 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 114.51M (114509707) - RpcRetry: 0 (0) - SerializeBatchTime: 17s723ms - UncompressedRowBatchSize: 3.51 GB (3764021877) CodeGen:(Total: 371.922ms, non-child: 371.922ms, % non-child: 100.00%) - CodegenTime: 2.606ms - CompileTime: 25.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 156.884ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 178.906ms HDFS_SCAN_NODE (id=2):(Total: 15s516ms, non-child: 15s516ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:86/3.67 GB 5:85/3.67 GB -1:10/417.77 MB 0:80/3.39 GB 7:69/2.70 GB 3:66/2.81 GB 4:96/3.99 GB 6:91/3.90 GB 2:80/3.37 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 442ms BytesRead(16s000ms): 12.67 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 14.13 MB, 29.08 MB, 71.50 MB, 133.04 MB, 207.76 MB, 285.67 MB, 365.97 MB, 418.39 MB, 452.39 MB, 489.21 MB, 538.43 MB, 586.85 MB, 632.28 MB, 684.10 MB, 729.80 MB, 780.23 MB, 847.18 MB, 914.86 MB, 1000.45 MB, 1.05 GB, 1.12 GB, 1.17 GB - FooterProcessingTime: (Avg: 2.673ms ; Min: 287.054us ; Max: 83.953ms ; Number of samples: 305) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.20 GB (1288111953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s667ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 305 (305) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519947) - PerReadThreadRawHdfsThroughput: 586.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 172.00M (171998665) - RowsReturned: 114.51M (114510731) - RowsReturnedRate: 7.38 M/sec - ScanRangesComplete: 516 (516) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 55s633ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s096ms - TotalReadThroughput: 2.02 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 663 (663) - RowGroups processed: 110.32K (110322) - RowGroups rejected: 0 (0) - RowGroups total: 111.95K (111951) - Rows processed: 9.16M (9155756) - Rows rejected: 0 (0) - Rows total: 171.68M (171676105) - Splits processed: 514 (514) - Splits rejected: 212 (212) - Splits total: 517 (517) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.18M (9176357) - Rows rejected: 51.75K (51746) - Rows total: 171.68M (171676105) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 116.51M (116514777) - Rows rejected: 57.21M (57206812) - Rows total: 171.62M (171624359) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001b (host=vc1541.foo.com:22000):(Total: 564.761ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:78/3.48 GB -1:12/498.83 MB 0:69/3.12 GB 6:84/3.14 GB 1:103/4.12 GB 5:89/4.00 GB 4:87/3.27 GB 7:83/3.26 GB 2:75/3.02 GB Filter 2 arrival: 6s540ms Filter 5 arrival: 4m40s Filter 4 arrival: 4m40s MemoryUsage(16s000ms): 47.27 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 58.90 MB, 57.64 MB, 32.10 MB, 34.58 MB, 35.41 MB, 38.77 MB, 35.43 MB, 42.59 MB, 37.60 MB, 37.66 MB, 41.93 MB, 43.78 MB, 36.95 MB, 35.35 MB, 39.77 MB, 40.26 MB, 37.98 MB, 37.67 MB, 36.58 MB, 34.96 MB, 39.79 MB, 36.62 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 64.71 MB (67854195) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.77 GB (6193313416) - RowsProduced: 115.48M (115479551) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m10s - TotalStorageWaitTime: 2s385ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 158.243ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 81.988ms - TotalThreadsVoluntaryContextSwitches: 34 (34) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s161ms - OpenTime: 158.247ms - ExecTreeOpenTime: 1.741ms - PrepareTime: 406.459ms - ExecTreePrepareTime: 13.340ms KrpcDataStreamSender (dst_id=22):(Total: 19s454ms, non-child: 19s454ms, % non-child: 100.00%) - BytesSent: 1.86 GB (1998256360) - OverallThroughput: 97.95 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 115.48M (115478527) - RpcRetry: 0 (0) - SerializeBatchTime: 19s176ms - UncompressedRowBatchSize: 3.53 GB (3789627468) CodeGen:(Total: 271.699ms, non-child: 271.699ms, % non-child: 100.00%) - CodegenTime: 1.627ms - CompileTime: 42.742ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 110.373ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 116.332ms HDFS_SCAN_NODE (id=2):(Total: 14s029ms, non-child: 14s029ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:78/3.48 GB -1:12/498.83 MB 0:69/3.12 GB 6:84/3.14 GB 1:103/4.12 GB 5:89/4.00 GB 4:87/3.27 GB 7:83/3.26 GB 2:75/3.02 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 482ms BytesRead(16s000ms): 14.84 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.27 MB, 19.79 MB, 38.59 MB, 110.33 MB, 181.79 MB, 256.96 MB, 331.07 MB, 407.65 MB, 449.41 MB, 509.51 MB, 553.96 MB, 607.87 MB, 651.03 MB, 697.81 MB, 748.77 MB, 802.53 MB, 856.05 MB, 910.05 MB, 953.75 MB, 1011.21 MB, 1.04 GB, 1.10 GB - FooterProcessingTime: (Avg: 2.136ms ; Min: 381.815us ; Max: 48.081ms ; Number of samples: 289) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.17 GB (1256450298) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s488ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 289 (289) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.41 MB (23499125) - PerReadThreadRawHdfsThroughput: 555.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 167.83M (167833649) - RowsReturned: 115.48M (115479551) - RowsReturnedRate: 8.23 M/sec - ScanRangesComplete: 491 (491) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s693ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s157ms - TotalReadThroughput: 1.98 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 680 (680) - RowGroups processed: 111.28K (111281) - RowGroups rejected: 1 (1) - RowGroups total: 112.90K (112903) - Rows processed: 8.41M (8411094) - Rows rejected: 0 (0) - Rows total: 167.71M (167708721) - Splits processed: 489 (489) - Splits rejected: 203 (203) - Splits total: 492 (492) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.39M (8387590) - Rows rejected: 47.73K (47727) - Rows total: 167.71M (167708721) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 107.31M (107306828) - Rows rejected: 52.14M (52142196) - Rows total: 167.66M (167660994) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000005 (host=vc1527.foo.com:22000):(Total: 547.713ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:78/3.18 GB 1:76/3.44 GB 4:94/4.17 GB -1:10/334.12 MB 0:91/3.84 GB 2:88/3.58 GB 7:79/3.20 GB 6:76/3.20 GB 5:70/2.98 GB Filter 2 arrival: 6s272ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m38s MemoryUsage(16s000ms): 42.19 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 52.44 MB, 34.51 MB, 34.84 MB, 35.83 MB, 35.75 MB, 37.40 MB, 39.56 MB, 37.29 MB, 37.96 MB, 36.26 MB, 39.87 MB, 39.41 MB, 40.18 MB, 38.18 MB, 38.11 MB, 38.86 MB, 41.64 MB, 36.29 MB, 34.69 MB, 40.34 MB, 38.76 MB, 38.35 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 67.82 MB (71118745) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.94 GB (6381215049) - RowsProduced: 127.23M (127232886) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m12s - TotalStorageWaitTime: 3s926ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 138.231ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 82.987ms - TotalThreadsVoluntaryContextSwitches: 32 (32) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 20s173ms - OpenTime: 138.235ms - ExecTreeOpenTime: 1.306ms - PrepareTime: 409.377ms - ExecTreePrepareTime: 25.068ms KrpcDataStreamSender (dst_id=22):(Total: 21s729ms, non-child: 21s729ms, % non-child: 100.00%) - BytesSent: 2.06 GB (2206829772) - OverallThroughput: 96.85 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 127.23M (127231862) - RpcRetry: 0 (0) - SerializeBatchTime: 21s580ms - UncompressedRowBatchSize: 3.90 GB (4182707892) CodeGen:(Total: 371.614ms, non-child: 371.614ms, % non-child: 100.00%) - CodegenTime: 3.587ms - CompileTime: 38.014ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 93.040ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 237.854ms HDFS_SCAN_NODE (id=2):(Total: 20s057ms, non-child: 20s057ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:78/3.18 GB 1:76/3.44 GB 4:94/4.17 GB -1:10/334.12 MB 0:91/3.84 GB 2:88/3.58 GB 7:79/3.20 GB 6:76/3.20 GB 5:70/2.98 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 502ms BytesRead(16s000ms): 11.55 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 15.28 MB, 24.76 MB, 51.31 MB, 87.68 MB, 162.11 MB, 235.17 MB, 310.45 MB, 357.03 MB, 420.11 MB, 480.78 MB, 537.03 MB, 611.20 MB, 675.55 MB, 737.25 MB, 801.33 MB, 872.81 MB, 947.73 MB, 1.00 GB, 1.07 GB, 1.16 GB, 1.24 GB, 1.29 GB - FooterProcessingTime: (Avg: 4.409ms ; Min: 370.426us ; Max: 217.414ms ; Number of samples: 341) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.34 GB (1440383017) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 8s482ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 341 (341) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.11 MB (27380481) - PerReadThreadRawHdfsThroughput: 574.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 192.90M (192904281) - RowsReturned: 127.23M (127232886) - RowsReturnedRate: 6.34 M/sec - ScanRangesComplete: 572 (572) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 55s911ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s389ms - TotalReadThroughput: 2.23 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 662 (662) - RowGroups processed: 122.95K (122950) - RowGroups rejected: 0 (0) - RowGroups total: 124.39K (124392) - Rows processed: 10.43M (10432884) - Rows rejected: 0 (0) - Rows total: 192.66M (192655449) - Splits processed: 568 (568) - Splits rejected: 232 (232) - Splits total: 573 (573) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.43M (10434822) - Rows rejected: 59.39K (59391) - Rows total: 192.66M (192655449) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 128.70M (128699597) - Rows rejected: 65.49M (65487076) - Rows total: 192.60M (192596058) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000006 (host=vc1529.foo.com:22000):(Total: 536.606ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:83/3.40 GB 3:79/3.22 GB 1:88/3.67 GB 7:87/3.48 GB 6:78/3.39 GB 2:77/3.33 GB 5:69/2.76 GB -1:13/575.63 MB 0:104/4.08 GB Filter 2 arrival: 6s346ms Filter 5 arrival: 4m38s Filter 4 arrival: 4m38s MemoryUsage(16s000ms): 41.89 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 46.47 MB, 35.85 MB, 32.71 MB, 38.08 MB, 38.20 MB, 37.40 MB, 37.02 MB, 41.79 MB, 40.78 MB, 41.73 MB, 35.17 MB, 38.54 MB, 37.62 MB, 37.68 MB, 39.38 MB, 36.20 MB, 36.84 MB, 38.95 MB, 35.62 MB, 41.13 MB, 37.19 MB, 42.64 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.97 MB (72321863) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.79 GB (6221954282) - RowsProduced: 119.18M (119176129) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m23s - TotalStorageWaitTime: 2s368ms - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 209.683ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 117.982ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12s995ms - OpenTime: 209.689ms - ExecTreeOpenTime: 1.900ms - PrepareTime: 326.862ms - ExecTreePrepareTime: 6.372ms KrpcDataStreamSender (dst_id=22):(Total: 18s568ms, non-child: 18s568ms, % non-child: 100.00%) - BytesSent: 1.92 GB (2065513929) - OverallThroughput: 106.08 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 119.18M (119175105) - RpcRetry: 0 (0) - SerializeBatchTime: 18s391ms - UncompressedRowBatchSize: 3.65 GB (3917655423) CodeGen:(Total: 349.166ms, non-child: 349.166ms, % non-child: 100.00%) - CodegenTime: 2.296ms - CompileTime: 62.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 131.674ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 144.012ms HDFS_SCAN_NODE (id=2):(Total: 12s843ms, non-child: 12s843ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:83/3.40 GB 3:79/3.22 GB 1:88/3.67 GB 7:87/3.48 GB 6:78/3.39 GB 2:77/3.33 GB 5:69/2.76 GB -1:13/575.63 MB 0:104/4.08 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 522ms BytesRead(16s000ms): 11.46 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 12.77 MB, 13.54 MB, 34.26 MB, 82.28 MB, 151.97 MB, 220.34 MB, 293.33 MB, 369.85 MB, 424.32 MB, 476.82 MB, 529.34 MB, 588.13 MB, 641.80 MB, 694.44 MB, 743.46 MB, 802.10 MB, 870.50 MB, 941.97 MB, 993.55 MB, 1.03 GB, 1.09 GB, 1.15 GB - FooterProcessingTime: (Avg: 1.816ms ; Min: 324.173us ; Max: 33.504ms ; Number of samples: 302) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.21 GB (1300801609) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s983ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 302 (302) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 25.66 MB (26907161) - PerReadThreadRawHdfsThroughput: 545.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 174.90M (174896601) - RowsReturned: 119.18M (119176129) - RowsReturnedRate: 9.28 M/sec - ScanRangesComplete: 462 (462) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 47s079ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s273ms - TotalReadThroughput: 2.05 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 678 (678) - RowGroups processed: 114.89K (114885) - RowGroups rejected: 1 (1) - RowGroups total: 116.52K (116515) - Rows processed: 8.94M (8939563) - Rows rejected: 0 (0) - Rows total: 173.87M (173874649) - Splits processed: 458 (458) - Splits rejected: 161 (161) - Splits total: 463 (463) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.85M (8847420) - Rows rejected: 49.34K (49342) - Rows total: 173.87M (173874649) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 109.98M (109981192) - Rows rejected: 55.55M (55546202) - Rows total: 173.83M (173825307) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000012 (host=vc1525.foo.com:22000):(Total: 527.959ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:67/2.99 GB 1:82/4.02 GB 4:83/3.97 GB -1:12/549.69 MB 0:73/3.31 GB 6:78/3.03 GB 3:72/3.45 GB 2:70/3.04 GB 7:76/3.54 GB Filter 2 arrival: 6s381ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 48.50 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 58.95 MB, 57.30 MB, 34.48 MB, 35.80 MB, 33.51 MB, 38.26 MB, 36.90 MB, 38.96 MB, 38.16 MB, 36.53 MB, 39.75 MB, 34.51 MB, 37.25 MB, 43.48 MB, 41.15 MB, 39.67 MB, 37.85 MB, 45.87 MB, 41.76 MB, 42.66 MB, 44.18 MB, 38.67 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 77.99 MB (81780533) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.69 GB (6111603385) - RowsProduced: 109.80M (109800818) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m22s - TotalStorageWaitTime: 1s831ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 178.976ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 94.986ms - TotalThreadsVoluntaryContextSwitches: 32 (32) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13s070ms - OpenTime: 178.980ms - ExecTreeOpenTime: 1.542ms - PrepareTime: 348.866ms - ExecTreePrepareTime: 9.391ms KrpcDataStreamSender (dst_id=22):(Total: 17s738ms, non-child: 17s738ms, % non-child: 100.00%) - BytesSent: 1.77 GB (1902037028) - OverallThroughput: 102.26 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 109.80M (109800818) - RpcRetry: 0 (0) - SerializeBatchTime: 17s613ms - UncompressedRowBatchSize: 3.36 GB (3610388331) CodeGen:(Total: 378.555ms, non-child: 378.555ms, % non-child: 100.00%) - CodegenTime: 4.354ms - CompileTime: 33.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 137.679ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 203.612ms HDFS_SCAN_NODE (id=2):(Total: 12s935ms, non-child: 12s935ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:67/2.99 GB 1:82/4.02 GB 4:83/3.97 GB -1:12/549.69 MB 0:73/3.31 GB 6:78/3.03 GB 3:72/3.45 GB 2:70/3.04 GB 7:76/3.54 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 521ms BytesRead(16s000ms): 11.33 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 13.30 MB, 25.13 MB, 57.34 MB, 124.43 MB, 203.70 MB, 275.73 MB, 339.19 MB, 400.39 MB, 447.45 MB, 499.19 MB, 550.19 MB, 604.43 MB, 658.53 MB, 702.14 MB, 745.40 MB, 788.28 MB, 851.73 MB, 896.06 MB, 962.79 MB, 1012.01 MB, 1.03 GB - FooterProcessingTime: (Avg: 1.975ms ; Min: 278.211us ; Max: 37.143ms ; Number of samples: 236) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.07 GB (1143996144) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s359ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 236 (236) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 34.68 MB (36366479) - PerReadThreadRawHdfsThroughput: 571.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 154.69M (154685603) - RowsReturned: 109.80M (109801842) - RowsReturnedRate: 8.49 M/sec - ScanRangesComplete: 388 (388) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 47s042ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1s907ms - TotalReadThroughput: 1.83 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 613 (613) - RowGroups processed: 105.69K (105690) - RowGroups rejected: 1 (1) - RowGroups total: 107.32K (107316) - Rows processed: 6.72M (6721788) - Rows rejected: 0 (0) - Rows total: 154.37M (154372259) - Splits processed: 386 (386) - Splits rejected: 153 (153) - Splits total: 389 (389) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 6.71M (6705404) - Rows rejected: 38.09K (38091) - Rows total: 154.37M (154372259) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 92.67M (92669841) - Rows rejected: 44.65M (44654182) - Rows total: 154.33M (154334168) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000a (host=vc1513.foo.com:22000):(Total: 518.057ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:76/3.13 GB 2:87/3.68 GB -1:13/470.26 MB 0:82/3.60 GB 6:95/4.11 GB 5:73/2.97 GB 7:80/3.50 GB 4:77/2.86 GB 3:83/3.59 GB Filter 2 arrival: 6s195ms Filter 4 arrival: 4m35s Filter 5 arrival: 4m35s MemoryUsage(16s000ms): 46.71 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 51.47 MB, 50.17 MB, 34.87 MB, 39.44 MB, 35.51 MB, 42.96 MB, 36.83 MB, 38.95 MB, 38.28 MB, 34.62 MB, 37.16 MB, 38.54 MB, 38.53 MB, 37.90 MB, 43.60 MB, 38.29 MB, 37.60 MB, 39.13 MB, 37.77 MB, 38.55 MB, 37.78 MB, 39.48 MB, 42.11 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 69.93 MB (73325385) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.93 GB (6365035797) - RowsProduced: 124.91M (124906915) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m36s - TotalStorageWaitTime: 2s994ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 236.542ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 94.985ms - TotalThreadsVoluntaryContextSwitches: 34 (34) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s650ms - OpenTime: 236.546ms - ExecTreeOpenTime: 1.636ms - PrepareTime: 281.448ms - ExecTreePrepareTime: 8.235ms KrpcDataStreamSender (dst_id=22):(Total: 19s982ms, non-child: 19s982ms, % non-child: 100.00%) - BytesSent: 2.02 GB (2166166037) - OverallThroughput: 103.38 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 124.91M (124906915) - RpcRetry: 0 (0) - SerializeBatchTime: 19s841ms - UncompressedRowBatchSize: 3.82 GB (4105891119) CodeGen:(Total: 366.618ms, non-child: 366.618ms, % non-child: 100.00%) - CodegenTime: 2.969ms - CompileTime: 94.898ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 136.455ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 131.457ms HDFS_SCAN_NODE (id=2):(Total: 14s491ms, non-child: 14s491ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:76/3.13 GB 2:87/3.68 GB -1:13/470.26 MB 0:82/3.60 GB 6:95/4.11 GB 5:73/2.97 GB 7:80/3.50 GB 4:77/2.86 GB 3:83/3.59 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 542ms BytesRead(16s000ms): 10.96 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 12.32 MB, 37.48 MB, 95.70 MB, 174.78 MB, 244.51 MB, 322.68 MB, 393.90 MB, 442.89 MB, 489.69 MB, 535.38 MB, 593.75 MB, 665.35 MB, 717.75 MB, 770.22 MB, 834.13 MB, 891.86 MB, 953.00 MB, 1012.93 MB, 1.07 GB, 1.13 GB, 1.21 GB, 1.26 GB - FooterProcessingTime: (Avg: 2.902ms ; Min: 265.045us ; Max: 190.342ms ; Number of samples: 328) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.31 GB (1401716874) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s894ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 328 (328) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 25.17 MB (26391359) - PerReadThreadRawHdfsThroughput: 572.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 187.73M (187728476) - RowsReturned: 124.91M (124907939) - RowsReturnedRate: 8.62 M/sec - ScanRangesComplete: 552 (552) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 56s698ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s333ms - TotalReadThroughput: 2.18 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 666 (666) - RowGroups processed: 120.48K (120484) - RowGroups rejected: 0 (0) - RowGroups total: 122.11K (122113) - Rows processed: 9.70M (9703210) - Rows rejected: 0 (0) - Rows total: 187.23M (187227740) - Splits processed: 549 (549) - Splits rejected: 225 (225) - Splits total: 553 (553) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.68M (9683813) - Rows rejected: 53.87K (53866) - Rows total: 187.23M (187227740) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 125.42M (125419641) - Rows rejected: 62.64M (62641743) - Rows total: 187.17M (187173874) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000000f (host=vc1508.foo.com:22000):(Total: 501.435ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:81/3.60 GB 2:92/3.97 GB 1:74/2.58 GB 4:71/2.99 GB 6:94/3.90 GB -1:12/635.54 MB 0:92/4.05 GB 3:70/2.88 GB 5:73/3.37 GB Filter 2 arrival: 5s373ms Filter 5 arrival: 4m35s Filter 4 arrival: 4m35s MemoryUsage(16s000ms): 40.33 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 43.06 MB, 39.17 MB, 36.78 MB, 40.59 MB, 34.36 MB, 37.63 MB, 40.29 MB, 39.54 MB, 37.29 MB, 38.39 MB, 37.05 MB, 35.37 MB, 33.90 MB, 40.06 MB, 38.29 MB, 43.06 MB, 40.03 MB, 38.02 MB, 41.86 MB, 43.60 MB, 39.71 MB, 40.59 MB, 39.38 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.93 MB (70179576) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.99 GB (6430698106) - RowsProduced: 135.82M (135815106) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m55s - TotalStorageWaitTime: 3s489ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 181.564ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 98.985ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s581ms - OpenTime: 181.568ms - ExecTreeOpenTime: 1.681ms - PrepareTime: 319.794ms - ExecTreePrepareTime: 6.590ms KrpcDataStreamSender (dst_id=22):(Total: 21s620ms, non-child: 21s620ms, % non-child: 100.00%) - BytesSent: 2.20 GB (2358737911) - OverallThroughput: 104.05 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 135.81M (135814082) - RpcRetry: 0 (0) - SerializeBatchTime: 21s474ms - UncompressedRowBatchSize: 4.17 GB (4472673909) CodeGen:(Total: 342.333ms, non-child: 342.333ms, % non-child: 100.00%) - CodegenTime: 4.502ms - CompileTime: 27.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 138.578ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 160.862ms HDFS_SCAN_NODE (id=2):(Total: 14s422ms, non-child: 14s422ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:81/3.60 GB 2:92/3.97 GB 1:74/2.58 GB 4:71/2.99 GB 6:94/3.90 GB -1:12/635.54 MB 0:92/4.05 GB 3:70/2.88 GB 5:73/3.37 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 541ms BytesRead(16s000ms): 11.48 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 12.66 MB, 13.46 MB, 51.95 MB, 123.78 MB, 182.36 MB, 233.65 MB, 292.04 MB, 351.17 MB, 414.77 MB, 485.45 MB, 542.64 MB, 603.70 MB, 663.60 MB, 718.31 MB, 786.53 MB, 859.60 MB, 927.53 MB, 991.82 MB, 1.05 GB, 1.12 GB, 1.19 GB, 1.25 GB, 1.31 GB - FooterProcessingTime: (Avg: 3.090ms ; Min: 337.966us ; Max: 169.679ms ; Number of samples: 335) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.38 GB (1478748474) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s944ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 335 (335) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519868) - PerReadThreadRawHdfsThroughput: 581.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 198.82M (198821803) - RowsReturned: 135.82M (135815106) - RowsReturnedRate: 9.42 M/sec - ScanRangesComplete: 564 (564) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 44s509ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s427ms - TotalReadThroughput: 2.28 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 659 (659) - RowGroups processed: 131.13K (131126) - RowGroups rejected: 1 (1) - RowGroups total: 132.76K (132760) - Rows processed: 9.83M (9825054) - Rows rejected: 0 (0) - Rows total: 198.03M (198033323) - Splits processed: 562 (562) - Splits rejected: 230 (230) - Splits total: 565 (565) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.81M (9805677) - Rows rejected: 56.25K (56246) - Rows total: 198.03M (198033323) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 129.17M (129167393) - Rows rejected: 62.30M (62303283) - Rows total: 197.98M (197977077) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000018 (host=vc1502.foo.com:22000):(Total: 463.628ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:72/3.20 GB 6:97/3.87 GB 1:74/3.40 GB 7:83/3.23 GB -1:12/395.41 MB 0:83/3.57 GB 4:78/3.20 GB 3:83/3.55 GB 5:79/3.51 GB Filter 2 arrival: 5s262ms Filter 4 arrival: 4m34s Filter 5 arrival: 4m34s MemoryUsage(16s000ms): 38.40 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 37.81 MB, 35.86 MB, 36.40 MB, 41.87 MB, 41.98 MB, 37.90 MB, 39.68 MB, 35.87 MB, 36.26 MB, 44.91 MB, 39.75 MB, 39.95 MB, 41.71 MB, 40.95 MB, 40.35 MB, 39.23 MB, 40.06 MB, 42.80 MB, 39.41 MB, 42.07 MB, 43.74 MB, 38.74 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 72.93 MB (76471229) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.79 GB (6215826445) - RowsProduced: 150.47M (150471892) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m42s - TotalStorageWaitTime: 2s916ms - TotalThreadsInvoluntaryContextSwitches: 25 (25) - TotalThreadsTotalWallClockTime: 210.904ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 95.986ms - TotalThreadsVoluntaryContextSwitches: 48 (48) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10s797ms - OpenTime: 210.908ms - ExecTreeOpenTime: 1.751ms - PrepareTime: 252.600ms - ExecTreePrepareTime: 10.097ms KrpcDataStreamSender (dst_id=22):(Total: 21s470ms, non-child: 21s470ms, % non-child: 100.00%) - BytesSent: 2.43 GB (2610108900) - OverallThroughput: 115.94 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 150.47M (150471892) - RpcRetry: 0 (0) - SerializeBatchTime: 21s340ms - UncompressedRowBatchSize: 4.61 GB (4947415407) CodeGen:(Total: 319.728ms, non-child: 319.728ms, % non-child: 100.00%) - CodegenTime: 2.541ms - CompileTime: 63.504ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 131.540ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 116.574ms HDFS_SCAN_NODE (id=2):(Total: 10s651ms, non-child: 10s651ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:72/3.20 GB 6:97/3.87 GB 1:74/3.40 GB 7:83/3.23 GB -1:12/395.41 MB 0:83/3.57 GB 4:78/3.20 GB 3:83/3.55 GB 5:79/3.51 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 582ms BytesRead(16s000ms): 20.14 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 22.01 MB, 23.60 MB, 59.78 MB, 137.22 MB, 234.92 MB, 328.15 MB, 423.56 MB, 506.41 MB, 556.14 MB, 632.69 MB, 701.71 MB, 783.38 MB, 871.37 MB, 954.55 MB, 1.01 GB, 1.08 GB, 1.16 GB, 1.24 GB, 1.31 GB, 1.38 GB, 1.45 GB, 1.51 GB - FooterProcessingTime: (Avg: 1.670ms ; Min: 391.560us ; Max: 59.212ms ; Number of samples: 374) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.57 GB (1683029521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s906ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 374 (374) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.11 MB (29477702) - PerReadThreadRawHdfsThroughput: 609.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 225.62M (225624144) - RowsReturned: 150.47M (150472916) - RowsReturnedRate: 14.13 M/sec - ScanRangesComplete: 643 (643) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 51s022ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s632ms - TotalReadThroughput: 2.65 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 661 (661) - RowGroups processed: 145.44K (145445) - RowGroups rejected: 1 (1) - RowGroups total: 147.09K (147088) - Rows processed: 11.11M (11107969) - Rows rejected: 0 (0) - Rows total: 224.21M (224207952) - Splits processed: 639 (639) - Splits rejected: 270 (270) - Splits total: 644 (644) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 11.10M (11099689) - Rows rejected: 62.47K (62467) - Rows total: 224.21M (224207952) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 152.75M (152747577) - Rows rejected: 74.96M (74963833) - Rows total: 224.15M (224145485) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001c (host=vc1531.foo.com:22000):(Total: 441.310ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:85/3.21 GB 7:74/2.88 GB 6:82/3.23 GB 2:76/3.17 GB 1:83/3.50 GB 5:73/3.16 GB 4:88/3.65 GB -1:9/510.25 MB 0:99/4.61 GB Filter 2 arrival: 6s370ms Filter 5 arrival: 4m38s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 51.11 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 56.97 MB, 36.40 MB, 34.78 MB, 36.57 MB, 36.80 MB, 38.42 MB, 36.26 MB, 40.33 MB, 38.76 MB, 41.18 MB, 36.62 MB, 40.23 MB, 41.19 MB, 38.05 MB, 37.48 MB, 40.90 MB, 41.69 MB, 40.17 MB, 41.63 MB, 40.40 MB, 44.97 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 64.93 MB (68082425) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.65 GB (6068711617) - RowsProduced: 122.90M (122897383) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m39s - TotalStorageWaitTime: 3s508ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 178.509ms - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 95.986ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12s163ms - OpenTime: 178.513ms - ExecTreeOpenTime: 1.384ms - PrepareTime: 262.712ms - ExecTreePrepareTime: 51.485ms KrpcDataStreamSender (dst_id=22):(Total: 18s481ms, non-child: 18s481ms, % non-child: 100.00%) - BytesSent: 1.99 GB (2135692768) - OverallThroughput: 110.21 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 122.90M (122897383) - RpcRetry: 0 (0) - SerializeBatchTime: 18s370ms - UncompressedRowBatchSize: 3.77 GB (4045683378) CodeGen:(Total: 263.437ms, non-child: 263.437ms, % non-child: 100.00%) - CodegenTime: 8.357ms - CompileTime: 54.952ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 112.403ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 93.656ms HDFS_SCAN_NODE (id=2):(Total: 12s118ms, non-child: 12s118ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:85/3.21 GB 7:74/2.88 GB 6:82/3.23 GB 2:76/3.17 GB 1:83/3.50 GB 5:73/3.16 GB 4:88/3.65 GB -1:9/510.25 MB 0:99/4.61 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 602ms BytesRead(16s000ms): 14.37 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 15.71 MB, 31.49 MB, 75.57 MB, 162.09 MB, 273.38 MB, 342.23 MB, 399.10 MB, 451.49 MB, 495.41 MB, 550.32 MB, 614.78 MB, 683.49 MB, 743.47 MB, 817.67 MB, 882.25 MB, 937.54 MB, 1005.85 MB, 1.06 GB, 1.15 GB, 1.20 GB, 1.27 GB - FooterProcessingTime: (Avg: 3.608ms ; Min: 331.197us ; Max: 194.864ms ; Number of samples: 316) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.30 GB (1396773537) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s935ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 316 (316) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519872) - PerReadThreadRawHdfsThroughput: 608.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 187.91M (187912781) - RowsReturned: 122.90M (122898407) - RowsReturnedRate: 10.14 M/sec - ScanRangesComplete: 521 (521) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 56s419ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s187ms - TotalReadThroughput: 2.24 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 669 (669) - RowGroups processed: 118.53K (118535) - RowGroups rejected: 0 (0) - RowGroups total: 120.16K (120161) - Rows processed: 9.54M (9543122) - Rows rejected: 0 (0) - Rows total: 187.44M (187438669) - Splits processed: 519 (519) - Splits rejected: 206 (206) - Splits total: 522 (522) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.50M (9495709) - Rows rejected: 53.06K (53062) - Rows total: 187.44M (187438669) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 130.90M (130902285) - Rows rejected: 64.84M (64836384) - Rows total: 187.39M (187385607) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001e (host=vc1520.foo.com:22000):(Total: 440.183ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:83/3.72 GB 2:67/2.76 GB 1:89/4.23 GB -1:14/483.67 MB 0:77/3.37 GB 7:85/3.92 GB 6:64/2.58 GB 5:82/3.19 GB 3:94/3.67 GB Filter 2 arrival: 6s327ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 53.50 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 59.22 MB, 58.20 MB, 35.19 MB, 35.09 MB, 37.53 MB, 40.85 MB, 37.99 MB, 40.32 MB, 38.42 MB, 37.19 MB, 36.83 MB, 36.64 MB, 38.24 MB, 39.26 MB, 36.76 MB, 38.69 MB, 40.21 MB, 42.02 MB, 43.20 MB, 41.05 MB, 39.70 MB, 43.01 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.97 MB (72321908) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.79 GB (6211673142) - RowsProduced: 132.66M (132657546) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m41s - TotalStorageWaitTime: 3s039ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 206.460ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 107.984ms - TotalThreadsVoluntaryContextSwitches: 28 (28) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 13s978ms - OpenTime: 206.463ms - ExecTreeOpenTime: 1.812ms - PrepareTime: 233.656ms - ExecTreePrepareTime: 20.046ms KrpcDataStreamSender (dst_id=22):(Total: 20s615ms, non-child: 20s615ms, % non-child: 100.00%) - BytesSent: 2.14 GB (2302172060) - OverallThroughput: 106.50 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 132.66M (132656522) - RpcRetry: 0 (0) - SerializeBatchTime: 20s484ms - UncompressedRowBatchSize: 4.06 GB (4363331115) CodeGen:(Total: 286.393ms, non-child: 286.393ms, % non-child: 100.00%) - CodegenTime: 4.043ms - CompileTime: 80.995ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 120.180ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 81.201ms HDFS_SCAN_NODE (id=2):(Total: 13s841ms, non-child: 13s841ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:83/3.72 GB 2:67/2.76 GB 1:89/4.23 GB -1:14/483.67 MB 0:77/3.37 GB 7:85/3.92 GB 6:64/2.58 GB 5:82/3.19 GB 3:94/3.67 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 602ms BytesRead(16s000ms): 16.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 18.08 MB, 40.98 MB, 113.40 MB, 194.82 MB, 299.71 MB, 383.07 MB, 448.73 MB, 505.32 MB, 561.94 MB, 608.75 MB, 657.85 MB, 706.68 MB, 773.97 MB, 848.44 MB, 902.15 MB, 959.02 MB, 1.01 GB, 1.07 GB, 1.15 GB, 1.22 GB, 1.30 GB - FooterProcessingTime: (Avg: 2.668ms ; Min: 421.436us ; Max: 90.124ms ; Number of samples: 333) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.37 GB (1470207463) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s942ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 333 (333) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.35 MB (25527907) - PerReadThreadRawHdfsThroughput: 582.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 197.06M (197056233) - RowsReturned: 132.66M (132657546) - RowsReturnedRate: 9.58 M/sec - ScanRangesComplete: 573 (573) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 52s675ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s407ms - TotalReadThroughput: 2.32 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 655 (655) - RowGroups processed: 128.05K (128054) - RowGroups rejected: 0 (0) - RowGroups total: 129.68K (129679) - Rows processed: 9.88M (9877737) - Rows rejected: 0 (0) - Rows total: 196.48M (196476649) - Splits processed: 571 (571) - Splits rejected: 241 (241) - Splits total: 574 (574) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.90M (9902861) - Rows rejected: 54.54K (54541) - Rows total: 196.48M (196476649) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 131.22M (131222466) - Rows rejected: 64.22M (64219218) - Rows total: 196.42M (196422108) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000025 (host=vc1540.foo.com:22000):(Total: 420.354ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:80/3.55 GB 4:58/2.39 GB 5:98/4.76 GB 3:95/4.00 GB 6:82/3.92 GB 7:74/2.51 GB 2:69/2.87 GB -1:13/626.94 MB 0:77/3.32 GB Filter 2 arrival: 6s607ms Filter 5 arrival: 4m40s Filter 4 arrival: 4m40s MemoryUsage(16s000ms): 43.04 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 50.46 MB, 49.35 MB, 32.47 MB, 36.24 MB, 39.09 MB, 40.09 MB, 39.91 MB, 40.13 MB, 37.40 MB, 37.21 MB, 38.39 MB, 37.31 MB, 44.17 MB, 41.43 MB, 39.19 MB, 39.30 MB, 45.28 MB, 42.09 MB, 36.04 MB, 39.63 MB, 41.42 MB, 44.73 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.14 MB (69348185) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.66 GB (6072597647) - RowsProduced: 115.06M (115064791) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m59s - TotalStorageWaitTime: 2s310ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 136.821ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 82.987ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10s922ms - OpenTime: 136.824ms - ExecTreeOpenTime: 1.553ms - PrepareTime: 283.438ms - ExecTreePrepareTime: 6.398ms KrpcDataStreamSender (dst_id=22):(Total: 19s564ms, non-child: 19s564ms, % non-child: 100.00%) - BytesSent: 1.86 GB (1998853686) - OverallThroughput: 97.43 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 115.06M (115063767) - RpcRetry: 0 (0) - SerializeBatchTime: 19s401ms - UncompressedRowBatchSize: 3.53 GB (3789627468) CodeGen:(Total: 248.290ms, non-child: 248.290ms, % non-child: 100.00%) - CodegenTime: 3.216ms - CompileTime: 51.487ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 80.899ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 112.259ms HDFS_SCAN_NODE (id=2):(Total: 10s780ms, non-child: 10s780ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:80/3.55 GB 4:58/2.39 GB 5:98/4.76 GB 3:95/4.00 GB 6:82/3.92 GB 7:74/2.51 GB 2:69/2.87 GB -1:13/626.94 MB 0:77/3.32 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 622ms BytesRead(16s000ms): 11.87 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 14.58 MB, 31.27 MB, 82.48 MB, 145.57 MB, 215.72 MB, 302.49 MB, 372.60 MB, 423.60 MB, 470.73 MB, 516.90 MB, 565.96 MB, 617.13 MB, 667.46 MB, 722.42 MB, 787.91 MB, 844.84 MB, 903.30 MB, 971.54 MB, 1.02 GB, 1.06 GB, 1.13 GB - FooterProcessingTime: (Avg: 2.014ms ; Min: 341.054us ; Max: 77.785ms ; Number of samples: 280) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.17 GB (1254997914) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s126ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 280 (280) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519868) - PerReadThreadRawHdfsThroughput: 560.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 169.25M (169247346) - RowsReturned: 115.07M (115065815) - RowsReturnedRate: 10.67 M/sec - ScanRangesComplete: 477 (477) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s003ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s136ms - TotalReadThroughput: 2.00 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 646 (646) - RowGroups processed: 110.81K (110807) - RowGroups rejected: 0 (0) - RowGroups total: 112.44K (112437) - Rows processed: 8.14M (8137973) - Rows rejected: 0 (0) - Rows total: 169.01M (169012850) - Splits processed: 474 (474) - Splits rejected: 198 (198) - Splits total: 478 (478) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.09M (8085749) - Rows rejected: 45.62K (45616) - Rows total: 169.01M (169012850) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 112.04M (112037216) - Rows rejected: 53.92M (53916779) - Rows total: 168.97M (168967234) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000007 (host=vc1526.foo.com:22000):(Total: 410.934ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:98/3.99 GB -1:13/598.34 MB 0:71/2.64 GB 6:80/3.34 GB 4:76/3.16 GB 2:92/3.81 GB 1:88/3.32 GB 3:84/3.81 GB 5:76/3.25 GB Filter 2 arrival: 6s450ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m38s MemoryUsage(16s000ms): 41.66 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.65 MB, 49.49 MB, 32.77 MB, 32.63 MB, 39.62 MB, 38.99 MB, 38.91 MB, 37.09 MB, 35.84 MB, 39.50 MB, 37.34 MB, 39.76 MB, 36.58 MB, 35.74 MB, 42.14 MB, 37.41 MB, 38.60 MB, 40.57 MB, 40.95 MB, 38.77 MB, 39.97 MB, 44.14 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 65.40 MB (68581321) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.69 GB (6108909502) - RowsProduced: 120.20M (120202314) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m21s - TotalStorageWaitTime: 2s711ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 116.941ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 81.987ms - TotalThreadsVoluntaryContextSwitches: 21 (21) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 18s327ms - OpenTime: 116.944ms - ExecTreeOpenTime: 1.135ms - PrepareTime: 293.925ms - ExecTreePrepareTime: 11.843ms KrpcDataStreamSender (dst_id=22):(Total: 20s622ms, non-child: 20s622ms, % non-child: 100.00%) - BytesSent: 1.94 GB (2082158517) - OverallThroughput: 96.29 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 120.20M (120201290) - RpcRetry: 0 (0) - SerializeBatchTime: 20s504ms - UncompressedRowBatchSize: 3.68 GB (3947413272) CodeGen:(Total: 279.992ms, non-child: 279.992ms, % non-child: 100.00%) - CodegenTime: 3.203ms - CompileTime: 22.900ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 87.019ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 159.506ms HDFS_SCAN_NODE (id=2):(Total: 18s199ms, non-child: 18s199ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:98/3.99 GB -1:13/598.34 MB 0:71/2.64 GB 6:80/3.34 GB 4:76/3.16 GB 2:92/3.81 GB 1:88/3.32 GB 3:84/3.81 GB 5:76/3.25 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 642ms BytesRead(16s000ms): 10.56 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 14.03 MB, 24.75 MB, 87.15 MB, 173.78 MB, 251.53 MB, 331.91 MB, 409.83 MB, 467.19 MB, 514.51 MB, 564.65 MB, 622.64 MB, 689.03 MB, 738.84 MB, 799.75 MB, 851.21 MB, 914.70 MB, 980.90 MB, 1.00 GB, 1.07 GB, 1.15 GB, 1.22 GB - FooterProcessingTime: (Avg: 2.267ms ; Min: 404.611us ; Max: 95.895ms ; Number of samples: 321) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.25 GB (1340907785) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s573ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 321 (321) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 23.68 MB (24832142) - PerReadThreadRawHdfsThroughput: 586.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 179.85M (179852002) - RowsReturned: 120.20M (120202314) - RowsReturnedRate: 6.60 M/sec - ScanRangesComplete: 517 (517) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 48s519ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s182ms - TotalReadThroughput: 2.14 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 678 (678) - RowGroups processed: 116.51K (116509) - RowGroups rejected: 1 (1) - RowGroups total: 117.53K (117533) - Rows processed: 9.71M (9705974) - Rows rejected: 0 (0) - Rows total: 179.35M (179353314) - Splits processed: 515 (515) - Splits rejected: 197 (197) - Splits total: 518 (518) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.68M (9677002) - Rows rejected: 53.67K (53666) - Rows total: 179.35M (179353314) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 118.80M (118799787) - Rows rejected: 59.31M (59305206) - Rows total: 179.30M (179299648) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001f (host=vc1522.foo.com:22000):(Total: 394.938ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:91/3.43 GB 7:80/2.97 GB 4:100/3.99 GB 1:92/3.45 GB 2:77/3.13 GB 6:80/3.04 GB -1:12/456.49 MB 0:99/4.19 GB 3:78/3.28 GB Filter 2 arrival: 6s427ms Filter 5 arrival: 4m37s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 45.82 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 53.95 MB, 50.38 MB, 31.58 MB, 34.38 MB, 37.04 MB, 40.80 MB, 38.31 MB, 39.73 MB, 37.70 MB, 35.84 MB, 38.38 MB, 35.73 MB, 40.08 MB, 43.27 MB, 43.07 MB, 38.20 MB, 36.30 MB, 38.62 MB, 41.98 MB, 41.04 MB, 40.26 MB, 41.84 MB, 42.39 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 67.01 MB (70264083) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.93 GB (6363922427) - RowsProduced: 142.87M (142865618) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m8s - TotalStorageWaitTime: 3s643ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 160.480ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 88.986ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12s088ms - OpenTime: 160.482ms - ExecTreeOpenTime: 1.208ms - PrepareTime: 234.398ms - ExecTreePrepareTime: 7.808ms KrpcDataStreamSender (dst_id=22):(Total: 20s847ms, non-child: 20s847ms, % non-child: 100.00%) - BytesSent: 2.31 GB (2485695530) - OverallThroughput: 113.71 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 142.86M (142864594) - RpcRetry: 0 (0) - SerializeBatchTime: 20s740ms - UncompressedRowBatchSize: 4.39 GB (4710044658) CodeGen:(Total: 279.403ms, non-child: 279.403ms, % non-child: 100.00%) - CodegenTime: 2.042ms - CompileTime: 16.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 136.739ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 125.115ms HDFS_SCAN_NODE (id=2):(Total: 11s941ms, non-child: 11s941ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:91/3.43 GB 7:80/2.97 GB 4:100/3.99 GB 1:92/3.45 GB 2:77/3.13 GB 6:80/3.04 GB -1:12/456.49 MB 0:99/4.19 GB 3:78/3.28 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 662ms BytesRead(16s000ms): 17.42 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 20.70 MB, 22.37 MB, 36.79 MB, 93.90 MB, 172.49 MB, 243.26 MB, 315.02 MB, 404.41 MB, 463.10 MB, 512.10 MB, 569.19 MB, 625.73 MB, 691.51 MB, 747.66 MB, 806.35 MB, 865.13 MB, 938.45 MB, 1.00 GB, 1.07 GB, 1.17 GB, 1.27 GB, 1.37 GB, 1.44 GB - FooterProcessingTime: (Avg: 2.974ms ; Min: 241.676us ; Max: 292.585ms ; Number of samples: 396) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.51 GB (1626638098) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s728ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 396 (396) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.19 MB (25367727) - PerReadThreadRawHdfsThroughput: 589.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 217.09M (217090227) - RowsReturned: 142.87M (142865618) - RowsReturnedRate: 11.96 M/sec - ScanRangesComplete: 680 (680) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 48s606ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s633ms - TotalReadThroughput: 2.52 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 709 (709) - RowGroups processed: 137.25K (137252) - RowGroups rejected: 1 (1) - RowGroups total: 139.63K (139628) - Rows processed: 11.80M (11804020) - Rows rejected: 0 (0) - Rows total: 216.82M (216817843) - Splits processed: 674 (674) - Splits rejected: 285 (285) - Splits total: 681 (681) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 11.79M (11792883) - Rows rejected: 66.27K (66267) - Rows total: 216.82M (216817843) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 148.88M (148878034) - Rows rejected: 74.06M (74055942) - Rows total: 216.75M (216751576) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000020 (host=vc1501.foo.com:22000):(Total: 374.852ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:76/3.14 GB 4:77/3.42 GB 2:77/3.04 GB -1:12/540.96 MB 0:84/3.53 GB 7:79/3.26 GB 5:83/3.84 GB 3:77/3.23 GB 6:89/3.94 GB Filter 2 arrival: 5s060ms Filter 4 arrival: 4m34s Filter 5 arrival: 4m34s MemoryUsage(16s000ms): 53.15 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 60.45 MB, 55.29 MB, 31.45 MB, 35.65 MB, 34.95 MB, 40.18 MB, 36.92 MB, 35.73 MB, 41.99 MB, 37.35 MB, 42.20 MB, 34.56 MB, 40.39 MB, 38.95 MB, 40.32 MB, 37.41 MB, 39.50 MB, 39.11 MB, 43.64 MB, 36.10 MB, 39.58 MB, 37.78 MB, 39.54 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.44 MB (71760666) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.87 GB (6300883586) - RowsProduced: 129.56M (129559101) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m37s - TotalStorageWaitTime: 3s142ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 179.178ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 93.986ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s875ms - OpenTime: 179.182ms - ExecTreeOpenTime: 1.820ms - PrepareTime: 195.597ms - ExecTreePrepareTime: 7.267ms KrpcDataStreamSender (dst_id=22):(Total: 21s501ms, non-child: 21s501ms, % non-child: 100.00%) - BytesSent: 2.09 GB (2249126744) - OverallThroughput: 99.76 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 129.56M (129558077) - RpcRetry: 0 (0) - SerializeBatchTime: 21s402ms - UncompressedRowBatchSize: 3.97 GB (4262292837) CodeGen:(Total: 267.064ms, non-child: 267.064ms, % non-child: 100.00%) - CodegenTime: 2.480ms - CompileTime: 46.392ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 128.160ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 89.637ms HDFS_SCAN_NODE (id=2):(Total: 14s735ms, non-child: 14s735ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:76/3.14 GB 4:77/3.42 GB 2:77/3.04 GB -1:12/540.96 MB 0:84/3.53 GB 7:79/3.26 GB 5:83/3.84 GB 3:77/3.23 GB 6:89/3.94 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 682ms BytesRead(16s000ms): 14.32 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 16.21 MB, 17.33 MB, 31.15 MB, 77.24 MB, 119.35 MB, 197.53 MB, 289.97 MB, 379.94 MB, 442.63 MB, 504.03 MB, 564.78 MB, 624.37 MB, 678.34 MB, 732.91 MB, 791.86 MB, 844.01 MB, 905.36 MB, 972.57 MB, 1.02 GB, 1.10 GB, 1.18 GB, 1.26 GB, 1.32 GB - FooterProcessingTime: (Avg: 2.637ms ; Min: 324.871us ; Max: 170.290ms ; Number of samples: 326) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.35 GB (1446585143) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s562ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 326 (326) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.10 MB (27368808) - PerReadThreadRawHdfsThroughput: 557.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 193.85M (193846155) - RowsReturned: 129.56M (129559101) - RowsReturnedRate: 8.79 M/sec - ScanRangesComplete: 563 (563) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s159ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s474ms - TotalReadThroughput: 2.26 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 654 (654) - RowGroups processed: 125.05K (125047) - RowGroups rejected: 1 (1) - RowGroups total: 126.67K (126670) - Rows processed: 9.87M (9866740) - Rows rejected: 0 (0) - Rows total: 193.47M (193469323) - Splits processed: 562 (562) - Splits rejected: 238 (238) - Splits total: 564 (564) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.87M (9865864) - Rows rejected: 55.62K (55616) - Rows total: 193.47M (193469323) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 132.21M (132210286) - Rows rejected: 64.11M (64106510) - Rows total: 193.41M (193413707) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000022 (host=vc1503.foo.com:22000):(Total: 374.060ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:80/3.44 GB 2:90/3.93 GB 3:73/3.12 GB 4:71/3.14 GB -1:12/584.54 MB 0:71/3.15 GB 5:79/2.80 GB 7:81/3.20 GB 6:104/4.62 GB Filter 2 arrival: 5s031ms Filter 5 arrival: 4m34s Filter 4 arrival: 4m34s MemoryUsage(16s000ms): 46.61 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 51.96 MB, 43.05 MB, 33.87 MB, 36.17 MB, 41.75 MB, 38.02 MB, 40.59 MB, 40.06 MB, 43.66 MB, 36.55 MB, 40.53 MB, 39.98 MB, 44.55 MB, 36.05 MB, 39.67 MB, 38.16 MB, 41.49 MB, 41.21 MB, 39.29 MB, 40.20 MB, 41.92 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 65.45 MB (68632450) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.59 GB (6004076589) - RowsProduced: 125.05M (125046029) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m28s - TotalStorageWaitTime: 2s658ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 106.198ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 73.988ms - TotalThreadsVoluntaryContextSwitches: 26 (26) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9s236ms - OpenTime: 106.201ms - ExecTreeOpenTime: 1.023ms - PrepareTime: 267.811ms - ExecTreePrepareTime: 6.678ms KrpcDataStreamSender (dst_id=22):(Total: 18s395ms, non-child: 18s395ms, % non-child: 100.00%) - BytesSent: 2.03 GB (2174638842) - OverallThroughput: 112.74 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 125.05M (125045005) - RpcRetry: 0 (0) - SerializeBatchTime: 18s209ms - UncompressedRowBatchSize: 3.84 GB (4121808108) CodeGen:(Total: 181.003ms, non-child: 181.003ms, % non-child: 100.00%) - CodegenTime: 2.736ms - CompileTime: 13.433ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 85.785ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 74.763ms HDFS_SCAN_NODE (id=2):(Total: 9s115ms, non-child: 9s115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:80/3.44 GB 2:90/3.93 GB 3:73/3.12 GB 4:71/3.14 GB -1:12/584.54 MB 0:71/3.15 GB 5:79/2.80 GB 7:81/3.20 GB 6:104/4.62 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 683ms BytesRead(16s000ms): 12.18 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 13.59 MB, 35.68 MB, 108.01 MB, 182.06 MB, 256.55 MB, 332.14 MB, 411.59 MB, 474.42 MB, 529.40 MB, 591.78 MB, 658.00 MB, 727.05 MB, 770.39 MB, 826.44 MB, 882.66 MB, 942.46 MB, 1016.06 MB, 1.06 GB, 1.14 GB, 1.22 GB - FooterProcessingTime: (Avg: 2.414ms ; Min: 402.964us ; Max: 82.871ms ; Number of samples: 320) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.30 GB (1399661515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s836ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 320 (320) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.11 MB (23186194) - PerReadThreadRawHdfsThroughput: 602.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 188.33M (188330299) - RowsReturned: 125.05M (125046029) - RowsReturnedRate: 13.72 M/sec - ScanRangesComplete: 524 (524) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 37s846ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s215ms - TotalReadThroughput: 2.26 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 661 (661) - RowGroups processed: 120.62K (120622) - RowGroups rejected: 0 (0) - RowGroups total: 122.25K (122251) - Rows processed: 9.33M (9333081) - Rows rejected: 0 (0) - Rows total: 187.90M (187898171) - Splits processed: 521 (521) - Splits rejected: 205 (205) - Splits total: 525 (525) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.34M (9342515) - Rows rejected: 53.60K (53598) - Rows total: 187.90M (187898171) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 127.95M (127947739) - Rows rejected: 62.96M (62962384) - Rows total: 187.84M (187844573) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000003 (host=vc1519.foo.com:22000):(Total: 373.515ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:81/2.92 GB 5:89/3.68 GB 4:66/2.86 GB 1:95/3.80 GB 3:77/3.76 GB 2:79/3.46 GB 6:80/3.02 GB -1:12/548.23 MB 0:87/3.88 GB Filter 2 arrival: 6s258ms Filter 5 arrival: 4m36s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 41.48 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 47.49 MB, 46.87 MB, 32.85 MB, 49.83 MB, 40.97 MB, 38.56 MB, 38.41 MB, 41.79 MB, 34.52 MB, 42.26 MB, 39.85 MB, 39.28 MB, 36.70 MB, 37.08 MB, 41.54 MB, 37.88 MB, 39.54 MB, 38.70 MB, 40.01 MB, 41.49 MB, 39.28 MB, 41.05 MB, 39.22 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 77.97 MB (81759128) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.86 GB (6295516807) - RowsProduced: 113.77M (113769182) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m16s - TotalStorageWaitTime: 2s423ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 147.495ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 99.985ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 15s839ms - OpenTime: 147.499ms - ExecTreeOpenTime: 1.554ms - PrepareTime: 225.268ms - ExecTreePrepareTime: 26.993ms KrpcDataStreamSender (dst_id=22):(Total: 18s404ms, non-child: 18s404ms, % non-child: 100.00%) - BytesSent: 1.84 GB (1971116567) - OverallThroughput: 102.14 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 113.77M (113769182) - RpcRetry: 0 (0) - SerializeBatchTime: 18s276ms - UncompressedRowBatchSize: 3.48 GB (3738416286) CodeGen:(Total: 214.364ms, non-child: 214.364ms, % non-child: 100.00%) - CodegenTime: 3.225ms - CompileTime: 35.260ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 98.595ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 75.568ms HDFS_SCAN_NODE (id=2):(Total: 15s743ms, non-child: 15s743ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:81/2.92 GB 5:89/3.68 GB 4:66/2.86 GB 1:95/3.80 GB 3:77/3.76 GB 2:79/3.46 GB 6:80/3.02 GB -1:12/548.23 MB 0:87/3.88 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 682ms BytesRead(16s000ms): 12.40 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 27.15 MB, 68.37 MB, 99.44 MB, 170.72 MB, 237.14 MB, 310.58 MB, 357.27 MB, 403.99 MB, 431.77 MB, 481.29 MB, 534.53 MB, 594.54 MB, 642.05 MB, 699.99 MB, 751.58 MB, 823.85 MB, 880.83 MB, 951.50 MB, 1.01 GB, 1.07 GB, 1.12 GB - FooterProcessingTime: (Avg: 2.402ms ; Min: 385.581us ; Max: 56.273ms ; Number of samples: 285) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.15 GB (1230718785) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s853ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 284 (284) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 34.20 MB (35861679) - PerReadThreadRawHdfsThroughput: 581.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 165.56M (165561301) - RowsReturned: 113.77M (113769182) - RowsReturnedRate: 7.23 M/sec - ScanRangesComplete: 474 (474) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 49s592ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s019ms - TotalReadThroughput: 1.92 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 666 (666) - RowGroups processed: 109.51K (109507) - RowGroups rejected: 0 (0) - RowGroups total: 111.14K (111139) - Rows processed: 8.36M (8361087) - Rows rejected: 0 (0) - Rows total: 165.56M (165561301) - Splits processed: 471 (471) - Splits rejected: 190 (190) - Splits total: 475 (475) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 8.39M (8387461) - Rows rejected: 47.48K (47477) - Rows total: 165.56M (165561301) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 103.74M (103735431) - Rows rejected: 51.72M (51716302) - Rows total: 165.51M (165513824) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000010 (host=vc1505.foo.com:22000):(Total: 358.754ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:84/3.63 GB 6:90/3.68 GB 7:73/2.93 GB 3:88/3.56 GB 4:91/3.72 GB 5:83/3.19 GB -1:8/446.28 MB 0:89/3.53 GB 2:77/3.24 GB Filter 2 arrival: 5s338ms Filter 4 arrival: 4m35s Filter 5 arrival: 4m35s MemoryUsage(16s000ms): 35.75 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 37.10 MB, 35.79 MB, 36.12 MB, 39.34 MB, 40.48 MB, 39.67 MB, 36.61 MB, 37.72 MB, 37.54 MB, 40.05 MB, 33.79 MB, 38.77 MB, 38.41 MB, 37.24 MB, 42.16 MB, 40.94 MB, 41.90 MB, 38.33 MB, 44.34 MB, 39.03 MB, 42.43 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.22 MB (71530583) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.59 GB (6000351434) - RowsProduced: 136.60M (136603595) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m21s - TotalStorageWaitTime: 2s552ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 133.883ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 85.987ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9s414ms - OpenTime: 133.886ms - ExecTreeOpenTime: 964.995us - PrepareTime: 224.811ms - ExecTreePrepareTime: 7.967ms KrpcDataStreamSender (dst_id=22):(Total: 20s071ms, non-child: 20s071ms, % non-child: 100.00%) - BytesSent: 2.21 GB (2373008249) - OverallThroughput: 112.75 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 136.60M (136602571) - RpcRetry: 0 (0) - SerializeBatchTime: 19s933ms - UncompressedRowBatchSize: 4.19 GB (4498971543) CodeGen:(Total: 204.208ms, non-child: 204.208ms, % non-child: 100.00%) - CodegenTime: 2.488ms - CompileTime: 32.046ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 95.793ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 64.542ms HDFS_SCAN_NODE (id=2):(Total: 9s272ms, non-child: 9s272ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:84/3.63 GB 6:90/3.68 GB 7:73/2.93 GB 3:88/3.56 GB 4:91/3.72 GB 5:83/3.19 GB -1:8/446.28 MB 0:89/3.53 GB 2:77/3.24 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 682ms BytesRead(16s000ms): 14.56 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 15.80 MB, 16.19 MB, 41.48 MB, 111.15 MB, 181.73 MB, 268.14 MB, 365.44 MB, 436.51 MB, 517.20 MB, 590.71 MB, 658.71 MB, 727.00 MB, 801.56 MB, 860.79 MB, 918.33 MB, 981.74 MB, 1.03 GB, 1.11 GB, 1.18 GB, 1.24 GB, 1.31 GB - FooterProcessingTime: (Avg: 1.400ms ; Min: 363.594us ; Max: 44.312ms ; Number of samples: 358) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.40 GB (1498790706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s599ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 358 (358) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519846) - PerReadThreadRawHdfsThroughput: 607.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 200.60M (200597793) - RowsReturned: 136.60M (136603595) - RowsReturnedRate: 14.73 M/sec - ScanRangesComplete: 595 (595) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 46s189ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s350ms - TotalReadThroughput: 2.42 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 683 (683) - RowGroups processed: 131.88K (131882) - RowGroups rejected: 1 (1) - RowGroups total: 133.52K (133519) - Rows processed: 10.29M (10292911) - Rows rejected: 0 (0) - Rows total: 200.39M (200387873) - Splits processed: 590 (590) - Splits rejected: 238 (238) - Splits total: 596 (596) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.28M (10276613) - Rows rejected: 57.83K (57826) - Rows total: 200.39M (200387873) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 133.82M (133818552) - Rows rejected: 63.81M (63811444) - Rows total: 200.33M (200330047) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000001d (host=vc1533.foo.com:22000):(Total: 337.703ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:83/3.52 GB 4:76/3.02 GB 3:101/3.81 GB 5:81/3.24 GB -1:11/500.43 MB 0:86/3.11 GB 6:89/3.93 GB 1:88/3.75 GB 2:78/3.03 GB Filter 2 arrival: 6s549ms Filter 5 arrival: 4m39s Filter 4 arrival: 4m39s MemoryUsage(16s000ms): 45.97 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 48.05 MB, 36.49 MB, 35.07 MB, 43.24 MB, 39.95 MB, 37.76 MB, 35.92 MB, 37.99 MB, 37.15 MB, 38.51 MB, 37.83 MB, 43.82 MB, 39.44 MB, 39.83 MB, 41.14 MB, 41.03 MB, 34.20 MB, 41.22 MB, 43.93 MB, 42.71 MB, 39.76 MB, 43.15 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 69.24 MB (72604681) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.85 GB (6285321243) - RowsProduced: 134.84M (134838003) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m1s - TotalStorageWaitTime: 2s509ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 112.026ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 80.987ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 14s495ms - OpenTime: 112.028ms - ExecTreeOpenTime: 967.693us - PrepareTime: 225.614ms - ExecTreePrepareTime: 14.421ms KrpcDataStreamSender (dst_id=22):(Total: 20s683ms, non-child: 20s683ms, % non-child: 100.00%) - BytesSent: 2.18 GB (2336066546) - OverallThroughput: 107.71 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 134.84M (134836979) - RpcRetry: 0 (0) - SerializeBatchTime: 20s561ms - UncompressedRowBatchSize: 4.13 GB (4429767243) CodeGen:(Total: 198.501ms, non-child: 198.501ms, % non-child: 100.00%) - CodegenTime: 3.027ms - CompileTime: 18.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 89.543ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 82.570ms HDFS_SCAN_NODE (id=2):(Total: 14s367ms, non-child: 14s367ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:83/3.52 GB 4:76/3.02 GB 3:101/3.81 GB 5:81/3.24 GB -1:11/500.43 MB 0:86/3.11 GB 6:89/3.93 GB 1:88/3.75 GB 2:78/3.03 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 723ms BytesRead(16s000ms): 16.54 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 18.05 MB, 31.41 MB, 82.86 MB, 155.74 MB, 231.66 MB, 294.03 MB, 351.49 MB, 400.69 MB, 458.88 MB, 516.87 MB, 577.83 MB, 657.26 MB, 726.40 MB, 793.85 MB, 853.52 MB, 927.58 MB, 999.65 MB, 1.06 GB, 1.14 GB, 1.21 GB, 1.28 GB, 1.34 GB - FooterProcessingTime: (Avg: 1.526ms ; Min: 413.417us ; Max: 38.733ms ; Number of samples: 350) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.38 GB (1485489979) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6s480ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 350 (350) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 28.10 MB (29460220) - PerReadThreadRawHdfsThroughput: 602.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 199.17M (199169146) - RowsReturned: 134.84M (134838003) - RowsReturnedRate: 9.38 M/sec - ScanRangesComplete: 600 (600) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 53s263ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s350ms - TotalReadThroughput: 2.33 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 693 (693) - RowGroups processed: 130.14K (130144) - RowGroups rejected: 0 (0) - RowGroups total: 131.78K (131778) - Rows processed: 10.30M (10299880) - Rows rejected: 0 (0) - Rows total: 199.17M (199169146) - Splits processed: 598 (598) - Splits rejected: 251 (251) - Splits total: 601 (601) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.34M (10337887) - Rows rejected: 59.76K (59760) - Rows total: 199.17M (199169146) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 128.07M (128074645) - Rows rejected: 64.17M (64169226) - Rows total: 199.11M (199109386) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000015 (host=vc1518.foo.com:22000):(Total: 244.099ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:87/3.49 GB 4:88/3.86 GB 7:85/3.42 GB 2:69/2.68 GB 1:84/3.62 GB 6:80/3.33 GB 5:97/3.80 GB -1:11/500.75 MB 0:81/3.21 GB Filter 2 arrival: 6s330ms Filter 5 arrival: 4m36s Filter 4 arrival: 4m37s MemoryUsage(16s000ms): 47.94 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 51.14 MB, 47.48 MB, 35.95 MB, 37.84 MB, 35.86 MB, 37.19 MB, 43.48 MB, 38.12 MB, 40.56 MB, 40.58 MB, 41.31 MB, 38.06 MB, 46.84 MB, 43.04 MB, 43.26 MB, 41.24 MB, 43.01 MB, 40.25 MB, 42.27 MB, 39.50 MB, 42.95 MB, 41.45 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 68.97 MB (72321954) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.66 GB (6073392215) - RowsProduced: 127.17M (127173243) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m5s - TotalStorageWaitTime: 2s725ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 98.942ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 86.987ms - TotalThreadsVoluntaryContextSwitches: 52 (52) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10s797ms - OpenTime: 98.945ms - ExecTreeOpenTime: 1.048ms - PrepareTime: 145.089ms - ExecTreePrepareTime: 7.977ms KrpcDataStreamSender (dst_id=22):(Total: 18s930ms, non-child: 18s930ms, % non-child: 100.00%) - BytesSent: 2.05 GB (2202840217) - OverallThroughput: 110.97 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 127.17M (127173243) - RpcRetry: 0 (0) - SerializeBatchTime: 18s863ms - UncompressedRowBatchSize: 3.89 GB (4176479505) CodeGen:(Total: 168.963ms, non-child: 168.963ms, % non-child: 100.00%) - CodegenTime: 2.387ms - CompileTime: 13.462ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 81.996ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 72.029ms HDFS_SCAN_NODE (id=2):(Total: 10s674ms, non-child: 10s674ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:87/3.49 GB 4:88/3.86 GB 7:85/3.42 GB 2:69/2.68 GB 1:84/3.62 GB 6:80/3.33 GB 5:97/3.80 GB -1:11/500.75 MB 0:81/3.21 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 803ms BytesRead(16s000ms): 16.69 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 17.80 MB, 45.84 MB, 110.29 MB, 190.40 MB, 268.56 MB, 335.11 MB, 408.37 MB, 471.60 MB, 526.36 MB, 586.27 MB, 640.66 MB, 706.64 MB, 768.25 MB, 832.16 MB, 893.55 MB, 959.35 MB, 1.00 GB, 1.07 GB, 1.15 GB, 1.21 GB, 1.28 GB - FooterProcessingTime: (Avg: 2.175ms ; Min: 320.771us ; Max: 66.772ms ; Number of samples: 323) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.31 GB (1406526682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s148ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 323 (323) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.19 MB (25367606) - PerReadThreadRawHdfsThroughput: 600.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 189.20M (189200904) - RowsReturned: 127.17M (127174267) - RowsReturnedRate: 11.91 M/sec - ScanRangesComplete: 553 (553) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 50s498ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s232ms - TotalReadThroughput: 2.25 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 682 (682) - RowGroups processed: 122.70K (122697) - RowGroups rejected: 0 (0) - RowGroups total: 124.33K (124334) - Rows processed: 9.98M (9984853) - Rows rejected: 0 (0) - Rows total: 188.74M (188739080) - Splits processed: 552 (552) - Splits rejected: 231 (231) - Splits total: 554 (554) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.95M (9952913) - Rows rejected: 55.43K (55427) - Rows total: 188.74M (188739080) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 124.20M (124201918) - Rows rejected: 61.85M (61846282) - Rows total: 188.68M (188683653) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000014 (host=vc1528.foo.com:22000):(Total: 221.799ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:73/3.18 GB 1:86/3.90 GB 3:74/3.10 GB -1:8/328.73 MB 0:81/2.99 GB 5:92/4.29 GB 4:71/2.94 GB 6:88/3.55 GB 7:81/3.66 GB Filter 2 arrival: 5s964ms Filter 5 arrival: 4m38s Filter 4 arrival: 4m38s MemoryUsage(16s000ms): 48.79 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 52.94 MB, 50.90 MB, 33.80 MB, 41.36 MB, 40.18 MB, 36.96 MB, 38.27 MB, 44.50 MB, 38.84 MB, 39.70 MB, 38.94 MB, 41.86 MB, 44.30 MB, 41.24 MB, 44.41 MB, 45.25 MB, 39.62 MB, 42.20 MB, 41.54 MB, 40.64 MB, 38.48 MB, 38.82 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.95 MB (70205230) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.72 GB (6138555565) - RowsProduced: 145.96M (145960391) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m35s - TotalStorageWaitTime: 3s095ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 84.071ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 66.990ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10s811ms - OpenTime: 84.075ms - ExecTreeOpenTime: 1.693ms - PrepareTime: 137.671ms - ExecTreePrepareTime: 11.296ms KrpcDataStreamSender (dst_id=22):(Total: 20s923ms, non-child: 20s923ms, % non-child: 100.00%) - BytesSent: 2.36 GB (2536718099) - OverallThroughput: 115.62 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 145.96M (145960391) - RpcRetry: 0 (0) - SerializeBatchTime: 20s854ms - UncompressedRowBatchSize: 4.48 GB (4809698850) CodeGen:(Total: 137.520ms, non-child: 137.520ms, % non-child: 100.00%) - CodegenTime: 1.510ms - CompileTime: 15.178ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 65.135ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 48.004ms HDFS_SCAN_NODE (id=2):(Total: 10s681ms, non-child: 10s681ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:73/3.18 GB 1:86/3.90 GB 3:74/3.10 GB -1:8/328.73 MB 0:81/2.99 GB 5:92/4.29 GB 4:71/2.94 GB 6:88/3.55 GB 7:81/3.66 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 823ms BytesRead(16s000ms): 12.46 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 13.68 MB, 14.33 MB, 50.84 MB, 139.04 MB, 219.65 MB, 304.61 MB, 396.20 MB, 479.13 MB, 539.31 MB, 614.77 MB, 688.51 MB, 750.27 MB, 825.05 MB, 901.30 MB, 977.90 MB, 1019.86 MB, 1.06 GB, 1.13 GB, 1.20 GB, 1.29 GB, 1.36 GB, 1.44 GB - FooterProcessingTime: (Avg: 2.277ms ; Min: 357.944us ; Max: 97.275ms ; Number of samples: 373) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.50 GB (1615243989) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s774ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 373 (373) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.34 MB (25519985) - PerReadThreadRawHdfsThroughput: 622.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 216.98M (216979270) - RowsReturned: 145.96M (145960391) - RowsReturnedRate: 13.66 M/sec - ScanRangesComplete: 603 (603) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 47s849ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s474ms - TotalReadThroughput: 2.57 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 654 (654) - RowGroups processed: 141.05K (141046) - RowGroups rejected: 0 (0) - RowGroups total: 142.67K (142670) - Rows processed: 10.93M (10928803) - Rows rejected: 0 (0) - Rows total: 216.83M (216827718) - Splits processed: 601 (601) - Splits rejected: 231 (231) - Splits total: 604 (604) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 10.88M (10878270) - Rows rejected: 60.98K (60982) - Rows total: 216.83M (216827718) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 141.54M (141536616) - Rows rejected: 70.74M (70735521) - Rows total: 216.77M (216766736) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000013 (host=vc1510.foo.com:22000):(Total: 198.894ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:103/4.37 GB 1:76/3.38 GB -1:13/579.16 MB 0:84/3.47 GB 6:82/3.31 GB 7:80/3.17 GB 3:81/3.17 GB 5:72/2.74 GB 4:94/3.72 GB Filter 2 arrival: 6s354ms Filter 4 arrival: 4m35s Filter 5 arrival: 4m35s MemoryUsage(16s000ms): 21.68 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 20.60 MB, 29.30 MB, 37.90 MB, 32.83 MB, 37.30 MB, 35.86 MB, 39.07 MB, 37.17 MB, 36.12 MB, 37.90 MB, 44.06 MB, 36.72 MB, 38.11 MB, 38.64 MB, 41.34 MB, 41.92 MB, 42.24 MB, 38.99 MB, 40.48 MB, 36.52 MB, 37.38 MB, 39.81 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.01 MB (2105344) - PeakMemoryUsage: 66.49 MB (69721967) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 5.70 GB (6119236925) - RowsProduced: 133.38M (133382321) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m4s - TotalStorageWaitTime: 2s573ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 81.457ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 72.989ms - TotalThreadsVoluntaryContextSwitches: 23 (23) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8s570ms - OpenTime: 81.460ms - ExecTreeOpenTime: 1.218ms - PrepareTime: 117.372ms - ExecTreePrepareTime: 11.341ms KrpcDataStreamSender (dst_id=22):(Total: 18s504ms, non-child: 18s504ms, % non-child: 100.00%) - BytesSent: 2.15 GB (2311111704) - OverallThroughput: 119.11 MB/sec - PeakMemoryUsage: 42.78 MB (44853176) - RowsReturned: 133.38M (133381297) - RpcRetry: 0 (0) - SerializeBatchTime: 18s438ms - UncompressedRowBatchSize: 4.08 GB (4382016276) CodeGen:(Total: 118.394ms, non-child: 118.394ms, % non-child: 100.00%) - CodegenTime: 2.501ms - CompileTime: 17.962ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 599 (599) - OptimizationTime: 57.124ms - PeakMemoryUsage: 299.50 KB (306688) - PrepareTime: 42.049ms HDFS_SCAN_NODE (id=2):(Total: 8s447ms, non-child: 8s447ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:103/4.37 GB 1:76/3.38 GB -1:13/579.16 MB 0:84/3.47 GB 6:82/3.31 GB 7:80/3.17 GB 3:81/3.17 GB 5:72/2.74 GB 4:94/3.72 GB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [2, 4, 5]), waited for 844ms BytesRead(16s000ms): 11.37 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 12.27 MB, 14.84 MB, 48.05 MB, 112.38 MB, 197.82 MB, 276.87 MB, 360.84 MB, 439.97 MB, 497.65 MB, 566.61 MB, 650.17 MB, 729.88 MB, 805.01 MB, 867.13 MB, 930.36 MB, 995.56 MB, 1.03 GB, 1.08 GB, 1.15 GB, 1.20 GB, 1.25 GB, 1.32 GB - FooterProcessingTime: (Avg: 1.924ms ; Min: 325.632us ; Max: 57.103ms ; Number of samples: 339) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.36 GB (1459366684) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5s481ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 339 (339) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 24.19 MB (25369516) - PerReadThreadRawHdfsThroughput: 612.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 195.33M (195332764) - RowsReturned: 133.38M (133382321) - RowsReturnedRate: 15.79 M/sec - ScanRangesComplete: 541 (541) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 45s003ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2s272ms - TotalReadThroughput: 2.32 MB/sec Filter 2 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 685 (685) - RowGroups processed: 128.74K (128741) - RowGroups rejected: 1 (1) - RowGroups total: 130.39K (130388) - Rows processed: 9.80M (9804965) - Rows rejected: 0 (0) - Rows total: 195.24M (195238556) - Splits processed: 540 (540) - Splits rejected: 203 (203) - Splits total: 542 (542) Filter 4 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 9.80M (9798731) - Rows rejected: 54.49K (54491) - Rows total: 195.24M (195238556) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 5 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 129.96M (129962334) - Rows rejected: 61.77M (61773827) - Rows total: 195.18M (195184065) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Averaged Fragment F04:(Total: 4m23s, non-child: 14s010ms, % non-child: 5.32%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:4m15s max:4m34s mean: 4m23s stddev:5s037ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 37 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.01 MB (3157019) - PeakMemoryUsage: 814.33 MB (853884084) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1105926587) - RowsProduced: 301.44K (301440) - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 7s167ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.18K (1175) - TotalThreadsTotalWallClockTime: 4m22s - TotalThreadsSysTime: 652.279ms - TotalThreadsUserTime: 7s506ms - TotalThreadsVoluntaryContextSwitches: 3.61K (3613) Fragment Instance Lifecycle Timings: - ExecTime: 1m17s - ExecTreeExecTime: 1m - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 927.853ms - ExecTreePrepareTime: 54.124ms KrpcDataStreamSender (dst_id=23):(Total: 3s266ms, non-child: 3s266ms, % non-child: 100.00%) - BytesSent: 44.39 MB (46546914) - OverallThroughput: 15.62 MB/sec - PeakMemoryUsage: 70.18 MB (73590638) - RowsReturned: 301.44K (301440) - RpcRetry: 0 (0) - SerializeBatchTime: 2s698ms - UncompressedRowBatchSize: 82.05 MB (86036299) CodeGen:(Total: 1s195ms, non-child: 1s195ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 334.766ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.27K (7266) - OptimizationTime: 598.696ms - PeakMemoryUsage: 3.55 MB (3720482) - PrepareTime: 250.329ms HASH_JOIN_NODE (id=11):(Total: 4m4s, non-child: 1s202ms, % non-child: 0.49%) - BuildRows: 402.00K (402000) - BuildTime: 903.542ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.44K (301440) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.741ms - RowsReturned: 301.44K (301440) - RowsReturnedRate: 1.23 K/sec Buffer pool: - AllocTime: 230.056ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): - BuildRowsPartitionTime: 787.567ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 114.314ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - ConvertRowBatchTime: 11.733ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.59 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 962.590ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m2s, non-child: 130.099ms, % non-child: 0.07%) - BuildRows: 122 (122) - BuildTime: 67.443ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.26K (306256) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.210ms - RowsReturned: 301.44K (301440) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 62.189ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.783ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 16.704us, non-child: 16.704us, % non-child: 100.00%) - ConvertRowBatchTime: 7.019us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.82 M/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.995us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.545us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m2s, non-child: 7s109ms, % non-child: 3.90%) - BuildRows: 7.03M (7027859) - BuildTime: 5s433ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5728009) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s351ms - RowsReturned: 306.26K (306256) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 4s446ms - BuildRowsPartitioned: 7.03M (7027859) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.13K (14126) - HashTablesBuildTime: 943.800ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 1m56s, % non-child: 100.00%) - ConvertRowBatchTime: 173.273ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027859) - RowsReturnedRate: 60.48 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.54 MB (435727309) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTime: 2s261ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s991ms, non-child: 58s991ms, % non-child: 100.00%) - ConvertRowBatchTime: 134.743ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5728009) - RowsReturnedRate: 97.64 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.12 MB (211936349) - TotalGetBatchTime: 58s853ms - DataArrivalTimer: 58s522ms SenderSide: - DeserializeRowBatchTime: 2s707ms - NumBatchesAccepted: 340 (340) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s341ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 66.523ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment F04: Instance b04615c310d227c4:327003730000009f (host=vc1529.foo.com:22000):(Total: 4m34s, non-child: 17s778ms, % non-child: 6.48%) MemoryUsage(8s000ms): 55.99 MB, 75.41 MB, 107.32 MB, 108.58 MB, 109.46 MB, 110.04 MB, 110.04 MB, 110.04 MB, 183.23 MB, 258.54 MB, 320.17 MB, 363.54 MB, 389.92 MB, 413.14 MB, 438.42 MB, 446.17 MB, 447.04 MB, 468.42 MB, 479.04 MB, 479.04 MB, 479.04 MB, 479.04 MB, 479.04 MB, 639.32 MB, 761.70 MB, 790.56 MB, 765.18 MB, 784.70 MB, 790.19 MB, 800.46 MB, 803.46 MB, 798.03 MB, 788.79 MB, 765.81 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.12 MB (3276800) - PeakMemoryUsage: 815.73 MB (855351802) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1098595135) - RowsProduced: 301.81K (301812) - TotalNetworkReceiveTime: 4m4s - TotalNetworkSendTime: 12s657ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.13K (1132) - TotalThreadsTotalWallClockTime: 4m34s - TotalThreadsSysTime: 635.903ms - TotalThreadsUserTime: 7s586ms - TotalThreadsVoluntaryContextSwitches: 3.58K (3576) Fragment Instance Lifecycle Timings: - ExecTime: 1m25s - ExecTreeExecTime: 1m5s - OpenTime: 3m8s - ExecTreeOpenTime: 3m7s - PrepareTime: 374.261ms - ExecTreePrepareTime: 20.617ms KrpcDataStreamSender (dst_id=23):(Total: 2s042ms, non-child: 2s042ms, % non-child: 100.00%) - BytesSent: 44.41 MB (46571879) - OverallThroughput: 21.74 MB/sec - PeakMemoryUsage: 71.69 MB (75167488) - RowsReturned: 301.81K (301812) - RpcRetry: 0 (0) - SerializeBatchTime: 1s911ms - UncompressedRowBatchSize: 82.13 MB (86115383) CodeGen:(Total: 1s043ms, non-child: 1s043ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 259.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 582.672ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 196.932ms HASH_JOIN_NODE (id=11):(Total: 4m13s, non-child: 1s020ms, % non-child: 0.40%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 591.479ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.81K (301812) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.041ms - RowsReturned: 301.81K (301812) - RowsReturnedRate: 1.19 K/sec Buffer pool: - AllocTime: 294.086ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 311.494ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 279.109ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 39.904ms, % non-child: 0.06%) - ConvertRowBatchTime: 11.910ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.29 K/sec RecvrSide: BytesReceived(2s000ms): 1.25 MB, 2.86 MB, 5.24 MB, 10.01 MB, 13.85 MB, 21.41 MB, 27.70 MB, 32.58 MB, 34.92 MB, 37.94 MB, 41.24 MB, 44.27 MB, 49.13 MB, 52.45 MB, 55.01 MB, 57.27 MB, 58.48 MB, 58.97 MB, 59.56 MB, 60.78 MB, 61.34 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.38 MB, 62.54 MB, 62.79 MB, 62.99 MB, 63.11 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 867.006ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m8s, non-child: 121.271ms, % non-child: 0.06%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 82.854ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.65K (306648) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.063ms - RowsReturned: 301.81K (301812) - RowsReturnedRate: 1.60 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 82.004ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 450.948us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 20.301us, non-child: 20.301us, % non-child: 100.00%) - ConvertRowBatchTime: 7.146us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.01 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 7.333us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 6.574us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m8s, non-child: 7s677ms, % non-child: 4.07%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7029569) - BuildTime: 6s109ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5731559) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s378ms - RowsReturned: 306.65K (306648) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s718ms - BuildRowsPartitioned: 7.03M (7029569) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.26K (14256) - HashTablesBuildTime: 1s342ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 298.353ms, % non-child: 0.26%) - ConvertRowBatchTime: 168.898ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7029569) - RowsReturnedRate: 60.39 K/sec RecvrSide: BytesReceived(4s000ms): 1.10 MB, 7.24 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 30.91 MB, 79.01 MB, 116.92 MB, 151.37 MB, 190.12 MB, 221.20 MB, 250.85 MB, 275.95 MB, 295.62 MB, 312.61 MB, 328.15 MB, 340.90 MB, 352.94 MB, 360.07 MB, 372.67 MB, 378.98 MB, 384.72 MB, 390.00 MB, 395.57 MB, 400.58 MB, 402.95 MB, 405.86 MB, 407.60 MB, 409.90 MB, 410.91 MB, 412.15 MB, 412.64 MB, 414.11 MB, 414.36 MB, 415.32 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.64 MB (435833278) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 1s909ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 43 (43) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 468.442ms, % non-child: 0.73%) - ConvertRowBatchTime: 140.614ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5731559) - RowsReturnedRate: 88.79 K/sec RecvrSide: BytesReceived(8s000ms): 7.22 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 30.46 MB, 74.12 MB, 110.52 MB, 145.88 MB, 170.02 MB, 186.10 MB, 196.35 MB, 200.13 MB, 201.62 MB, 202.19 MB, 202.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.24 MB (212067683) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m4s SenderSide: - DeserializeRowBatchTime: 2s326ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 54 (54) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s751ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 81.787ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a1 (host=vc1519.foo.com:22000):(Total: 4m31s, non-child: 14s010ms, % non-child: 5.16%) MemoryUsage(8s000ms): 51.15 MB, 73.87 MB, 105.21 MB, 107.98 MB, 108.68 MB, 109.39 MB, 109.39 MB, 109.39 MB, 189.12 MB, 254.61 MB, 309.92 MB, 354.89 MB, 381.01 MB, 408.67 MB, 432.67 MB, 442.92 MB, 442.92 MB, 459.79 MB, 474.92 MB, 474.92 MB, 474.92 MB, 474.92 MB, 474.92 MB, 631.45 MB, 764.38 MB, 793.99 MB, 768.52 MB, 789.01 MB, 796.48 MB, 805.68 MB, 808.32 MB, 806.21 MB, 797.13 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 820.27 MB (860111170) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1109733429) - RowsProduced: 301.64K (301639) - TotalNetworkReceiveTime: 4m4s - TotalNetworkSendTime: 7s072ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.16K (1155) - TotalThreadsTotalWallClockTime: 4m31s - TotalThreadsSysTime: 583.911ms - TotalThreadsUserTime: 7s601ms - TotalThreadsVoluntaryContextSwitches: 3.52K (3523) Fragment Instance Lifecycle Timings: - ExecTime: 1m22s - ExecTreeExecTime: 1m5s - OpenTime: 3m8s - ExecTreeOpenTime: 3m7s - PrepareTime: 273.473ms - ExecTreePrepareTime: 20.252ms KrpcDataStreamSender (dst_id=23):(Total: 3s217ms, non-child: 3s217ms, % non-child: 100.00%) - BytesSent: 44.42 MB (46578445) - OverallThroughput: 13.81 MB/sec - PeakMemoryUsage: 70.60 MB (74028800) - RowsReturned: 301.64K (301639) - RpcRetry: 0 (0) - SerializeBatchTime: 3s101ms - UncompressedRowBatchSize: 82.12 MB (86107577) CodeGen:(Total: 994.773ms, non-child: 994.773ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 325.009ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 567.514ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 97.163ms HASH_JOIN_NODE (id=11):(Total: 4m13s, non-child: 1s061ms, % non-child: 0.42%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 796.185ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.64K (301639) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.107ms - RowsReturned: 301.64K (301639) - RowsReturnedRate: 1.19 K/sec Buffer pool: - AllocTime: 104.962ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 735.998ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 59.474ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m2s, non-child: 35.142ms, % non-child: 0.06%) - ConvertRowBatchTime: 12.145ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.42 K/sec RecvrSide: BytesReceived(2s000ms): 744.57 KB, 2.62 MB, 4.68 MB, 9.04 MB, 13.85 MB, 20.88 MB, 26.45 MB, 31.57 MB, 34.40 MB, 37.46 MB, 41.24 MB, 44.27 MB, 48.41 MB, 51.93 MB, 54.68 MB, 57.01 MB, 58.36 MB, 59.15 MB, 59.64 MB, 60.52 MB, 61.23 MB, 61.62 MB, 61.82 MB, 62.06 MB, 62.26 MB, 62.59 MB, 62.79 MB, 62.87 MB, 63.23 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m2s - DataArrivalTimer: 1m2s SenderSide: - DeserializeRowBatchTime: 583.038ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m9s, non-child: 147.908ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 115.981ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.50K (306501) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.206ms - RowsReturned: 301.64K (301639) - RowsReturnedRate: 1.59 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 115.170ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 426.149us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 13.130us, non-child: 13.130us, % non-child: 100.00%) - ConvertRowBatchTime: 4.804us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 9.29 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.150us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 9.425us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m9s, non-child: 6s672ms, % non-child: 3.52%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7028104) - BuildTime: 5s047ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729324) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s338ms - RowsReturned: 306.50K (306501) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s092ms - BuildRowsPartitioned: 7.03M (7028104) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.32K (14325) - HashTablesBuildTime: 914.423ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 248.601ms, % non-child: 0.21%) - ConvertRowBatchTime: 171.401ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7028104) - RowsReturnedRate: 59.36 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 7.08 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 34.03 MB, 76.74 MB, 112.20 MB, 150.53 MB, 187.68 MB, 218.42 MB, 248.24 MB, 274.01 MB, 294.56 MB, 310.16 MB, 327.65 MB, 341.28 MB, 351.98 MB, 362.45 MB, 371.93 MB, 377.17 MB, 382.95 MB, 389.33 MB, 394.55 MB, 400.24 MB, 402.46 MB, 405.01 MB, 407.45 MB, 408.83 MB, 410.69 MB, 411.91 MB, 412.42 MB, 413.91 MB, 414.21 MB, 415.09 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.56 MB (435742448) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 2s366ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 512.898ms, % non-child: 0.80%) - ConvertRowBatchTime: 135.422ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729324) - RowsReturnedRate: 89.18 K/sec RecvrSide: BytesReceived(8s000ms): 6.54 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 29.22 MB, 71.40 MB, 110.28 MB, 144.07 MB, 168.69 MB, 185.10 MB, 195.15 MB, 199.98 MB, 201.37 MB, 201.97 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.16 MB (211984988) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 2s488ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 53 (53) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s493ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 114.997ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a2 (host=vc1510.foo.com:22000):(Total: 4m31s, non-child: 10s280ms, % non-child: 3.79%) MemoryUsage(8s000ms): 57.14 MB, 77.48 MB, 113.39 MB, 118.27 MB, 119.85 MB, 120.97 MB, 121.13 MB, 121.39 MB, 199.32 MB, 266.04 MB, 328.98 MB, 370.90 MB, 401.54 MB, 422.78 MB, 451.42 MB, 454.92 MB, 454.92 MB, 479.04 MB, 486.92 MB, 487.86 MB, 487.92 MB, 487.92 MB, 487.92 MB, 675.37 MB, 771.59 MB, 794.89 MB, 775.23 MB, 798.49 MB, 801.51 MB, 810.91 MB, 816.38 MB, 814.00 MB, 805.89 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 826.01 MB (866132426) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1099213829) - RowsProduced: 301.09K (301093) - TotalNetworkReceiveTime: 4m10s - TotalNetworkSendTime: 7s205ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.22K (1217) - TotalThreadsTotalWallClockTime: 4m31s - TotalThreadsSysTime: 633.903ms - TotalThreadsUserTime: 7s226ms - TotalThreadsVoluntaryContextSwitches: 3.12K (3122) Fragment Instance Lifecycle Timings: - ExecTime: 1m22s - ExecTreeExecTime: 1m10s - OpenTime: 3m8s - ExecTreeOpenTime: 3m7s - PrepareTime: 142.648ms - ExecTreePrepareTime: 5.791ms KrpcDataStreamSender (dst_id=23):(Total: 1s825ms, non-child: 1s825ms, % non-child: 100.00%) - BytesSent: 44.30 MB (46454257) - OverallThroughput: 24.27 MB/sec - PeakMemoryUsage: 70.59 MB (74020608) - RowsReturned: 301.09K (301093) - RpcRetry: 0 (0) - SerializeBatchTime: 1s764ms - UncompressedRowBatchSize: 81.93 MB (85913731) CodeGen:(Total: 720.740ms, non-child: 720.740ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 225.135ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 434.753ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 59.489ms HASH_JOIN_NODE (id=11):(Total: 4m18s, non-child: 893.900ms, % non-child: 0.35%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 626.008ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.09K (301093) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.177ms - RowsReturned: 301.09K (301093) - RowsReturnedRate: 1.16 K/sec Buffer pool: - AllocTime: 208.811ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 436.273ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 189.157ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m4s, non-child: 801.796ms, % non-child: 1.25%) - ConvertRowBatchTime: 11.803ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.25 K/sec RecvrSide: BytesReceived(2s000ms): 1.05 MB, 2.82 MB, 4.88 MB, 9.57 MB, 14.29 MB, 20.81 MB, 26.81 MB, 32.06 MB, 34.68 MB, 37.78 MB, 41.75 MB, 44.67 MB, 48.60 MB, 52.14 MB, 54.93 MB, 57.20 MB, 58.39 MB, 59.03 MB, 59.84 MB, 60.84 MB, 61.39 MB, 61.74 MB, 61.94 MB, 62.18 MB, 62.42 MB, 62.67 MB, 62.87 MB, 62.99 MB, 63.15 MB, 63.19 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 1s099ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m13s, non-child: 76.752ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 46.473ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.93K (305931) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 25.979ms - RowsReturned: 301.09K (301093) - RowsReturnedRate: 1.56 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 43.151ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.020ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 23.301us, non-child: 23.301us, % non-child: 100.00%) - ConvertRowBatchTime: 14.667us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 5.24 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.291us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 7.025us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m13s, non-child: 7s153ms, % non-child: 3.70%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7030993) - BuildTime: 5s641ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5725244) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s307ms - RowsReturned: 305.93K (305931) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s818ms - BuildRowsPartitioned: 7.03M (7030993) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.05K (14052) - HashTablesBuildTime: 779.418ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 318.313ms, % non-child: 0.27%) - ConvertRowBatchTime: 175.211ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7030993) - RowsReturnedRate: 60.23 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.08 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 39.76 MB, 84.32 MB, 121.80 MB, 157.44 MB, 195.43 MB, 225.16 MB, 250.01 MB, 278.56 MB, 297.10 MB, 314.26 MB, 332.07 MB, 344.69 MB, 355.81 MB, 366.09 MB, 374.74 MB, 379.53 MB, 385.53 MB, 390.85 MB, 397.29 MB, 401.21 MB, 403.35 MB, 406.25 MB, 408.14 MB, 409.87 MB, 411.29 MB, 412.21 MB, 413.39 MB, 413.90 MB, 414.61 MB, 415.34 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.73 MB (435921566) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 2s306ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m9s, non-child: 202.492ms, % non-child: 0.29%) - ConvertRowBatchTime: 133.281ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5725244) - RowsReturnedRate: 82.53 K/sec RecvrSide: BytesReceived(8s000ms): 6.94 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 36.60 MB, 76.83 MB, 115.14 MB, 147.69 MB, 171.13 MB, 187.15 MB, 196.27 MB, 200.04 MB, 201.30 MB, 201.89 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.02 MB (211834028) - TotalGetBatchTime: 1m9s - DataArrivalTimer: 1m9s SenderSide: - DeserializeRowBatchTime: 1s978ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 41 (41) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s207ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 45.642ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000009b (host=vc1536.foo.com:22000):(Total: 4m29s, non-child: 21s395ms, % non-child: 7.94%) MemoryUsage(8s000ms): 53.76 MB, 78.09 MB, 109.92 MB, 113.59 MB, 113.96 MB, 114.46 MB, 114.46 MB, 130.31 MB, 199.68 MB, 259.47 MB, 317.36 MB, 355.68 MB, 390.61 MB, 411.07 MB, 435.79 MB, 443.17 MB, 444.07 MB, 470.48 MB, 480.67 MB, 480.67 MB, 480.67 MB, 480.67 MB, 480.67 MB, 712.07 MB, 761.59 MB, 791.52 MB, 778.83 MB, 791.38 MB, 796.13 MB, 805.23 MB, 801.69 MB, 791.87 MB, 778.77 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 818.04 MB (857776586) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1126889674) - RowsProduced: 301.27K (301268) - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 10s563ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.22K (1216) - TotalThreadsTotalWallClockTime: 4m28s - TotalThreadsSysTime: 689.895ms - TotalThreadsUserTime: 7s803ms - TotalThreadsVoluntaryContextSwitches: 4.14K (4142) Fragment Instance Lifecycle Timings: - ExecTime: 1m22s - ExecTreeExecTime: 57s722ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 783.186ms - ExecTreePrepareTime: 146.599ms KrpcDataStreamSender (dst_id=23):(Total: 4s013ms, non-child: 4s013ms, % non-child: 100.00%) - BytesSent: 44.35 MB (46500934) - OverallThroughput: 11.05 MB/sec - PeakMemoryUsage: 70.62 MB (74053376) - RowsReturned: 301.27K (301268) - RpcRetry: 0 (0) - SerializeBatchTime: 3s629ms - UncompressedRowBatchSize: 81.99 MB (85968581) CodeGen:(Total: 1s356ms, non-child: 1s356ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 471.365ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 656.902ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 225.721ms HASH_JOIN_NODE (id=11):(Total: 4m2s, non-child: 1s312ms, % non-child: 0.54%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 809.496ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.27K (301268) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.616ms - RowsReturned: 301.27K (301268) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 208.914ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 696.186ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 112.593ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 58s886ms, non-child: 149.155ms, % non-child: 0.25%) - ConvertRowBatchTime: 12.229ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.83 K/sec RecvrSide: BytesReceived(1s000ms): 908.15 KB, 1.94 MB, 2.90 MB, 3.55 MB, 4.68 MB, 6.85 MB, 8.31 MB, 10.74 MB, 12.76 MB, 17.04 MB, 21.33 MB, 23.56 MB, 25.97 MB, 28.79 MB, 31.37 MB, 32.98 MB, 34.28 MB, 35.81 MB, 37.58 MB, 39.11 MB, 40.16 MB, 41.48 MB, 43.50 MB, 46.40 MB, 48.88 MB, 50.72 MB, 52.33 MB, 54.06 MB, 54.97 MB, 56.27 MB, 57.33 MB, 58.10 MB, 58.60 MB, 58.98 MB, 59.27 MB, 59.36 MB, 59.76 MB, 60.16 MB, 60.72 MB, 61.20 MB, 61.38 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.34 MB, 62.34 MB, 62.58 MB, 62.91 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 58s872ms - DataArrivalTimer: 58s737ms SenderSide: - DeserializeRowBatchTime: 1s256ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m2s, non-child: 119.589ms, % non-child: 0.07%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 16.192ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.21K (306211) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.889ms - RowsReturned: 301.27K (301268) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 4.532ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 11.337ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 12.092us, non-child: 12.092us, % non-child: 100.00%) - ConvertRowBatchTime: 5.274us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 10.09 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 2.638us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 11.547us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m2s, non-child: 7s491ms, % non-child: 4.11%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7031670) - BuildTime: 5s359ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726838) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s368ms - RowsReturned: 306.21K (306211) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s359ms - BuildRowsPartitioned: 7.03M (7031670) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.03K (14025) - HashTablesBuildTime: 939.039ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 345.426ms, % non-child: 0.29%) - ConvertRowBatchTime: 175.798ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7031670) - RowsReturnedRate: 59.34 K/sec RecvrSide: BytesReceived(4s000ms): 1.26 MB, 7.58 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 21.31 MB, 44.48 MB, 81.03 MB, 116.33 MB, 151.45 MB, 190.79 MB, 223.22 MB, 248.24 MB, 272.33 MB, 296.44 MB, 313.95 MB, 327.86 MB, 341.73 MB, 353.22 MB, 364.89 MB, 373.97 MB, 379.98 MB, 385.30 MB, 388.58 MB, 396.65 MB, 400.86 MB, 403.35 MB, 406.44 MB, 407.93 MB, 409.97 MB, 411.12 MB, 412.30 MB, 413.34 MB, 414.21 MB, 414.47 MB, 415.52 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.77 MB (435963540) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 6s346ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 56s217ms, non-child: 511.033ms, % non-child: 0.91%) - ConvertRowBatchTime: 135.224ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726838) - RowsReturnedRate: 101.87 K/sec RecvrSide: BytesReceived(8s000ms): 7.42 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.87 MB, 74.28 MB, 110.36 MB, 145.84 MB, 170.65 MB, 186.85 MB, 196.64 MB, 200.30 MB, 201.58 MB, 202.08 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.08 MB (211893006) - TotalGetBatchTime: 56s079ms - DataArrivalTimer: 55s706ms SenderSide: - DeserializeRowBatchTime: 2s873ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 44 (44) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s385ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 15.407ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000097 (host=vc1516.foo.com:22000):(Total: 4m28s, non-child: 18s150ms, % non-child: 6.75%) MemoryUsage(8s000ms): 53.87 MB, 76.67 MB, 107.75 MB, 109.10 MB, 109.16 MB, 109.63 MB, 109.63 MB, 109.66 MB, 188.86 MB, 262.37 MB, 316.17 MB, 356.87 MB, 391.36 MB, 410.42 MB, 435.75 MB, 444.17 MB, 444.17 MB, 467.42 MB, 476.17 MB, 476.17 MB, 476.17 MB, 476.17 MB, 476.17 MB, 711.28 MB, 763.88 MB, 793.93 MB, 771.25 MB, 794.08 MB, 799.48 MB, 807.56 MB, 813.02 MB, 804.86 MB, 782.83 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 820.85 MB (860725634) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1112486005) - RowsProduced: 301.45K (301446) - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 11s682ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.25K (1254) - TotalThreadsTotalWallClockTime: 4m28s - TotalThreadsSysTime: 690.895ms - TotalThreadsUserTime: 7s653ms - TotalThreadsVoluntaryContextSwitches: 3.80K (3804) Fragment Instance Lifecycle Timings: - ExecTime: 1m22s - ExecTreeExecTime: 1m1s - OpenTime: 3m6s - ExecTreeOpenTime: 3m5s - PrepareTime: 492.701ms - ExecTreePrepareTime: 19.112ms KrpcDataStreamSender (dst_id=23):(Total: 2s889ms, non-child: 2s889ms, % non-child: 100.00%) - BytesSent: 44.41 MB (46563521) - OverallThroughput: 15.37 MB/sec - PeakMemoryUsage: 73.69 MB (77264640) - RowsReturned: 301.45K (301446) - RpcRetry: 0 (0) - SerializeBatchTime: 2s678ms - UncompressedRowBatchSize: 82.07 MB (86060500) CodeGen:(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 393.119ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 624.990ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 199.371ms HASH_JOIN_NODE (id=11):(Total: 4m6s, non-child: 1s165ms, % non-child: 0.47%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 762.699ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.45K (301446) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.379ms - RowsReturned: 301.45K (301446) - RowsReturnedRate: 1.22 K/sec Buffer pool: - AllocTime: 189.402ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 707.540ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.510ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 16.007ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.463ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.35 K/sec RecvrSide: BytesReceived(2s000ms): 827.38 KB, 2.78 MB, 4.80 MB, 9.57 MB, 13.77 MB, 21.25 MB, 26.94 MB, 32.06 MB, 34.84 MB, 37.66 MB, 41.43 MB, 44.31 MB, 49.08 MB, 52.21 MB, 54.81 MB, 57.08 MB, 58.28 MB, 59.03 MB, 59.59 MB, 60.76 MB, 61.34 MB, 61.74 MB, 61.90 MB, 62.14 MB, 62.42 MB, 62.63 MB, 62.75 MB, 62.99 MB, 63.11 MB, 63.19 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 581.634ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m2s, non-child: 372.693ms, % non-child: 0.20%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 340.558ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.33K (306327) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.681ms - RowsReturned: 301.45K (301446) - RowsReturnedRate: 1.66 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 339.756ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 423.137us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 24.182us, non-child: 24.182us, % non-child: 100.00%) - ConvertRowBatchTime: 14.851us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 5.05 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.223us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.682us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m1s, non-child: 7s295ms, % non-child: 4.01%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7028686) - BuildTime: 5s555ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5725887) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s381ms - RowsReturned: 306.33K (306327) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s488ms - BuildRowsPartitioned: 7.03M (7028686) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.15K (14151) - HashTablesBuildTime: 920.574ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 311.340ms, % non-child: 0.27%) - ConvertRowBatchTime: 173.203ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7028686) - RowsReturnedRate: 61.42 K/sec RecvrSide: BytesReceived(4s000ms): 862.57 KB, 6.82 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 30.75 MB, 81.03 MB, 119.02 MB, 156.17 MB, 192.39 MB, 222.72 MB, 251.51 MB, 274.20 MB, 296.74 MB, 315.15 MB, 328.91 MB, 339.43 MB, 351.26 MB, 364.17 MB, 373.77 MB, 379.64 MB, 386.14 MB, 391.49 MB, 397.07 MB, 401.53 MB, 403.74 MB, 405.97 MB, 408.09 MB, 410.01 MB, 411.06 MB, 412.15 MB, 413.25 MB, 414.01 MB, 414.43 MB, 415.30 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.59 MB (435778532) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 2s005ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 41 (41) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m, non-child: 886.803ms, % non-child: 1.48%) - ConvertRowBatchTime: 137.017ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5725887) - RowsReturnedRate: 95.38 K/sec RecvrSide: BytesReceived(8s000ms): 7.02 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.28 MB, 73.84 MB, 111.81 MB, 145.60 MB, 170.45 MB, 186.13 MB, 196.85 MB, 200.23 MB, 201.55 MB, 202.04 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.04 MB (211857819) - TotalGetBatchTime: 59s893ms - DataArrivalTimer: 59s146ms SenderSide: - DeserializeRowBatchTime: 4s389ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 41 (41) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s315ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 339.523ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000009e (host=vc1509.foo.com:22000):(Total: 4m28s, non-child: 16s634ms, % non-child: 6.20%) MemoryUsage(8s000ms): 30.38 MB, 90.02 MB, 115.80 MB, 121.45 MB, 122.13 MB, 122.13 MB, 122.13 MB, 135.07 MB, 197.34 MB, 264.48 MB, 315.79 MB, 358.79 MB, 386.59 MB, 407.42 MB, 432.73 MB, 440.42 MB, 440.42 MB, 460.17 MB, 472.42 MB, 472.42 MB, 472.42 MB, 472.42 MB, 472.42 MB, 680.52 MB, 758.86 MB, 785.75 MB, 768.49 MB, 786.88 MB, 792.26 MB, 799.15 MB, 800.51 MB, 788.58 MB, 780.92 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 807.26 MB (846471602) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1106939172) - RowsProduced: 302.01K (302007) - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 9s215ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.19K (1185) - TotalThreadsTotalWallClockTime: 4m22s - TotalThreadsSysTime: 682.896ms - TotalThreadsUserTime: 7s526ms - TotalThreadsVoluntaryContextSwitches: 3.69K (3694) Fragment Instance Lifecycle Timings: - ExecTime: 1m21s - ExecTreeExecTime: 1m1s - OpenTime: 3m1s - ExecTreeOpenTime: 3m - PrepareTime: 5s342ms - ExecTreePrepareTime: 30.162ms KrpcDataStreamSender (dst_id=23):(Total: 7s677ms, non-child: 7s677ms, % non-child: 100.00%) - BytesSent: 44.45 MB (46610636) - OverallThroughput: 5.79 MB/sec - PeakMemoryUsage: 67.61 MB (70891264) - RowsReturned: 302.01K (302007) - RpcRetry: 0 (0) - SerializeBatchTime: 3s412ms - UncompressedRowBatchSize: 82.20 MB (86193643) CodeGen:(Total: 2s328ms, non-child: 2s328ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 467.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 845.155ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 959.858ms HASH_JOIN_NODE (id=11):(Total: 4m1s, non-child: 949.915ms, % non-child: 0.39%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 663.602ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.01K (302007) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.119ms - RowsReturned: 302.01K (302007) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 284.540ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 319.217ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 343.746ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 54s405ms, non-child: 57.752ms, % non-child: 0.11%) - ConvertRowBatchTime: 11.532ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 7.39 K/sec RecvrSide: BytesReceived(1s000ms): 1.05 MB, 1.13 MB, 1.13 MB, 1.21 MB, 2.50 MB, 5.00 MB, 8.96 MB, 12.03 MB, 14.13 MB, 18.33 MB, 21.57 MB, 24.04 MB, 26.86 MB, 29.84 MB, 31.93 MB, 32.66 MB, 32.90 MB, 34.27 MB, 37.25 MB, 39.60 MB, 41.59 MB, 42.94 MB, 44.63 MB, 46.81 MB, 49.37 MB, 50.64 MB, 52.17 MB, 53.87 MB, 54.97 MB, 55.95 MB, 57.25 MB, 58.10 MB, 58.52 MB, 59.01 MB, 59.17 MB, 59.44 MB, 59.76 MB, 60.24 MB, 60.80 MB, 61.20 MB, 61.46 MB, 61.70 MB, 61.86 MB, 61.86 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.34 MB, 62.42 MB, 62.50 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 54s392ms - DataArrivalTimer: 54s348ms SenderSide: - DeserializeRowBatchTime: 1s347ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m6s, non-child: 104.704ms, % non-child: 0.06%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 29.792ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.88K (306878) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.720ms - RowsReturned: 302.01K (302007) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 29.122ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 322.292us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.757us, non-child: 14.757us, % non-child: 100.00%) - ConvertRowBatchTime: 6.335us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.27 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.564us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 30.661us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m6s, non-child: 6s943ms, % non-child: 3.73%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7030416) - BuildTime: 5s408ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727895) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s367ms - RowsReturned: 306.88K (306878) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s503ms - BuildRowsPartitioned: 7.03M (7030416) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.28K (14276) - HashTablesBuildTime: 861.457ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m59s, non-child: 303.040ms, % non-child: 0.25%) - ConvertRowBatchTime: 171.088ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7030416) - RowsReturnedRate: 58.87 K/sec RecvrSide: BytesReceived(4s000ms): 0, 5.81 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 23.84 MB, 45.49 MB, 78.51 MB, 120.62 MB, 157.35 MB, 192.39 MB, 223.90 MB, 254.22 MB, 276.34 MB, 290.72 MB, 313.60 MB, 329.35 MB, 341.99 MB, 353.19 MB, 363.85 MB, 372.38 MB, 378.56 MB, 384.64 MB, 390.14 MB, 395.86 MB, 400.47 MB, 402.39 MB, 404.88 MB, 407.73 MB, 409.68 MB, 410.95 MB, 412.10 MB, 413.16 MB, 414.14 MB, 414.47 MB, 415.40 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.69 MB (435885792) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTime: 2s266ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 59s875ms, non-child: 426.237ms, % non-child: 0.71%) - ConvertRowBatchTime: 134.085ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727895) - RowsReturnedRate: 95.66 K/sec RecvrSide: BytesReceived(8s000ms): 4.70 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 36.16 MB, 74.71 MB, 113.11 MB, 146.67 MB, 169.95 MB, 186.65 MB, 196.13 MB, 200.02 MB, 201.52 MB, 202.09 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.11 MB (211932115) - TotalGetBatchTime: 59s737ms - DataArrivalTimer: 59s448ms SenderSide: - DeserializeRowBatchTime: 3s064ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s289ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 28.963ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a0 (host=vc1526.foo.com:22000):(Total: 4m27s, non-child: 12s297ms, % non-child: 4.59%) MemoryUsage(8s000ms): 55.76 MB, 75.53 MB, 106.48 MB, 108.45 MB, 110.56 MB, 111.03 MB, 111.03 MB, 111.16 MB, 184.19 MB, 259.57 MB, 311.50 MB, 354.29 MB, 387.56 MB, 412.92 MB, 434.92 MB, 448.47 MB, 449.67 MB, 469.29 MB, 481.67 MB, 482.54 MB, 482.67 MB, 482.67 MB, 483.29 MB, 649.07 MB, 763.44 MB, 794.28 MB, 787.30 MB, 800.26 MB, 804.82 MB, 809.97 MB, 807.51 MB, 810.18 MB, 806.91 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 825.38 MB (865477138) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1129777417) - RowsProduced: 302.01K (302008) - TotalNetworkReceiveTime: 4m2s - TotalNetworkSendTime: 3s061ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.21K (1210) - TotalThreadsTotalWallClockTime: 4m27s - TotalThreadsSysTime: 691.895ms - TotalThreadsUserTime: 7s494ms - TotalThreadsVoluntaryContextSwitches: 3.89K (3891) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m3s - OpenTime: 3m8s - ExecTreeOpenTime: 3m7s - PrepareTime: 344.243ms - ExecTreePrepareTime: 2.909ms KrpcDataStreamSender (dst_id=23):(Total: 3s935ms, non-child: 3s935ms, % non-child: 100.00%) - BytesSent: 44.47 MB (46631665) - OverallThroughput: 11.30 MB/sec - PeakMemoryUsage: 70.72 MB (74151680) - RowsReturned: 302.01K (302008) - RpcRetry: 0 (0) - SerializeBatchTime: 3s797ms - UncompressedRowBatchSize: 82.20 MB (86192863) CodeGen:(Total: 1s126ms, non-child: 1s126ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 343.368ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 623.919ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 156.486ms HASH_JOIN_NODE (id=11):(Total: 4m10s, non-child: 1s284ms, % non-child: 0.51%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s104ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.01K (302008) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.271ms - RowsReturned: 302.01K (302008) - RowsReturnedRate: 1.21 K/sec Buffer pool: - AllocTime: 203.507ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s049ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.541ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 32.459ms, % non-child: 0.05%) - ConvertRowBatchTime: 11.633ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.35 K/sec RecvrSide: BytesReceived(2s000ms): 1.01 MB, 2.34 MB, 5.40 MB, 10.01 MB, 14.37 MB, 21.97 MB, 27.70 MB, 32.14 MB, 34.76 MB, 37.70 MB, 41.52 MB, 44.84 MB, 49.29 MB, 52.14 MB, 55.17 MB, 57.45 MB, 58.51 MB, 59.11 MB, 59.68 MB, 60.68 MB, 61.31 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.38 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.11 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 610.928ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m5s, non-child: 70.493ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 40.800ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.79K (306789) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.733ms - RowsReturned: 302.01K (302008) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 33.477ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.010ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 11.408us, non-child: 11.408us, % non-child: 100.00%) - ConvertRowBatchTime: 4.246us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 10.69 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 2.791us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 9.929us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m5s, non-child: 6s696ms, % non-child: 3.60%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7025604) - BuildTime: 5s217ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727935) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s313ms - RowsReturned: 306.79K (306789) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s351ms - BuildRowsPartitioned: 7.03M (7025604) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.13K (14133) - HashTablesBuildTime: 836.678ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m57s, non-child: 298.607ms, % non-child: 0.25%) - ConvertRowBatchTime: 171.745ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7025604) - RowsReturnedRate: 59.93 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.24 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 32.85 MB, 77.50 MB, 115.57 MB, 154.32 MB, 188.35 MB, 220.02 MB, 250.85 MB, 274.00 MB, 291.11 MB, 311.62 MB, 328.50 MB, 340.83 MB, 352.37 MB, 362.24 MB, 372.66 MB, 377.24 MB, 383.82 MB, 389.16 MB, 395.43 MB, 400.36 MB, 402.56 MB, 405.18 MB, 407.39 MB, 409.26 MB, 410.59 MB, 411.83 MB, 412.42 MB, 413.92 MB, 414.09 MB, 415.03 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.41 MB (435587448) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 2s283ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m1s, non-child: 522.115ms, % non-child: 0.84%) - ConvertRowBatchTime: 129.679ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727935) - RowsReturnedRate: 92.41 K/sec RecvrSide: BytesReceived(8s000ms): 6.82 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 31.18 MB, 73.44 MB, 111.75 MB, 146.11 MB, 169.79 MB, 186.59 MB, 195.13 MB, 200.02 MB, 201.42 MB, 201.95 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.12 MB (211933595) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 3s335ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 46 (46) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s414ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 40.016ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:32700373000000a3 (host=vc1528.foo.com:22000):(Total: 4m27s, non-child: 8s666ms, % non-child: 3.24%) MemoryUsage(8s000ms): 55.14 MB, 74.38 MB, 106.26 MB, 108.73 MB, 110.03 MB, 110.55 MB, 110.68 MB, 110.81 MB, 187.92 MB, 258.51 MB, 316.67 MB, 358.47 MB, 383.70 MB, 414.20 MB, 438.23 MB, 448.42 MB, 448.42 MB, 471.11 MB, 482.04 MB, 483.42 MB, 483.42 MB, 483.42 MB, 483.42 MB, 659.31 MB, 758.39 MB, 791.02 MB, 772.36 MB, 793.73 MB, 798.26 MB, 806.48 MB, 808.72 MB, 800.94 MB, 793.77 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 820.76 MB (860627426) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1113279635) - RowsProduced: 301.57K (301572) - TotalNetworkReceiveTime: 4m6s - TotalNetworkSendTime: 3s679ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.15K (1153) - TotalThreadsTotalWallClockTime: 4m27s - TotalThreadsSysTime: 599.909ms - TotalThreadsUserTime: 7s251ms - TotalThreadsVoluntaryContextSwitches: 3.27K (3266) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m8s - OpenTime: 3m7s - ExecTreeOpenTime: 3m7s - PrepareTime: 176.903ms - ExecTreePrepareTime: 8.821ms KrpcDataStreamSender (dst_id=23):(Total: 2s126ms, non-child: 2s126ms, % non-child: 100.00%) - BytesSent: 44.36 MB (46515486) - OverallThroughput: 20.86 MB/sec - PeakMemoryUsage: 69.59 MB (72972032) - RowsReturned: 301.57K (301572) - RpcRetry: 0 (0) - SerializeBatchTime: 2s066ms - UncompressedRowBatchSize: 82.01 MB (85992927) CodeGen:(Total: 697.795ms, non-child: 697.795ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 187.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 430.477ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 73.341ms HASH_JOIN_NODE (id=11):(Total: 4m15s, non-child: 1s278ms, % non-child: 0.50%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 850.124ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.57K (301572) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 122.892ms - RowsReturned: 301.57K (301572) - RowsReturnedRate: 1.18 K/sec Buffer pool: - AllocTime: 13.073ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 810.284ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 39.234ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 23.019ms, % non-child: 0.04%) - ConvertRowBatchTime: 11.671ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.32 K/sec RecvrSide: BytesReceived(2s000ms): 1.09 MB, 2.98 MB, 5.40 MB, 10.34 MB, 15.34 MB, 21.75 MB, 27.94 MB, 32.70 MB, 35.08 MB, 38.06 MB, 41.98 MB, 44.75 MB, 49.37 MB, 52.53 MB, 55.21 MB, 57.43 MB, 58.48 MB, 59.11 MB, 59.72 MB, 60.80 MB, 61.34 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.34 MB, 62.63 MB, 62.87 MB, 62.99 MB, 63.11 MB, 63.19 MB, 63.31 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 1s153ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=10):(Total: 3m11s, non-child: 76.204ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 45.639ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.47K (306468) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.580ms - RowsReturned: 301.57K (301572) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 36.029ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 9.244ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 16.053us, non-child: 16.053us, % non-child: 100.00%) - ConvertRowBatchTime: 7.487us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.60 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.255us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.969us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m11s, non-child: 7s821ms, % non-child: 4.09%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.02M (7023824) - BuildTime: 6s360ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.72M (5724582) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s323ms - RowsReturned: 306.47K (306468) - RowsReturnedRate: 1.60 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 5s540ms - BuildRowsPartitioned: 7.02M (7023824) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.99K (13988) - HashTablesBuildTime: 782.634ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m55s, non-child: 280.621ms, % non-child: 0.24%) - ConvertRowBatchTime: 172.553ms - PeakMemoryUsage: 0 - RowsReturned: 7.02M (7023824) - RowsReturnedRate: 60.65 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.41 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 32.35 MB, 78.76 MB, 113.30 MB, 153.90 MB, 190.62 MB, 219.52 MB, 246.56 MB, 274.90 MB, 294.78 MB, 308.58 MB, 328.17 MB, 341.30 MB, 353.60 MB, 364.00 MB, 373.21 MB, 379.00 MB, 384.21 MB, 390.31 MB, 396.18 MB, 399.93 MB, 402.77 MB, 405.28 MB, 407.46 MB, 409.20 MB, 410.63 MB, 411.88 MB, 412.64 MB, 413.49 MB, 414.08 MB, 414.87 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.30 MB (435477088) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTime: 2s021ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m7s, non-child: 393.028ms, % non-child: 0.58%) - ConvertRowBatchTime: 132.029ms - PeakMemoryUsage: 0 - RowsReturned: 5.72M (5724582) - RowsReturnedRate: 84.94 K/sec RecvrSide: BytesReceived(8s000ms): 7.10 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 34.89 MB, 74.67 MB, 113.83 MB, 146.01 MB, 170.31 MB, 187.01 MB, 195.66 MB, 199.90 MB, 201.24 MB, 201.84 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.00 MB (211809534) - TotalGetBatchTime: 1m7s - DataArrivalTimer: 1m7s SenderSide: - DeserializeRowBatchTime: 2s480ms - NumBatchesAccepted: 340 (340) - NumBatchesDeferred: 47 (47) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s914ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 44.879ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000009c (host=vc1518.foo.com:22000):(Total: 4m27s, non-child: 12s664ms, % non-child: 4.74%) MemoryUsage(8s000ms): 57.29 MB, 75.62 MB, 108.08 MB, 111.31 MB, 112.49 MB, 112.81 MB, 112.81 MB, 127.41 MB, 197.79 MB, 266.29 MB, 320.47 MB, 364.84 MB, 394.86 MB, 420.29 MB, 442.36 MB, 454.29 MB, 454.67 MB, 473.67 MB, 486.67 MB, 486.67 MB, 486.67 MB, 486.67 MB, 486.67 MB, 689.85 MB, 758.83 MB, 788.07 MB, 764.58 MB, 785.41 MB, 791.82 MB, 801.94 MB, 808.41 MB, 806.17 MB, 785.70 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 818.79 MB (858563042) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1107671654) - RowsProduced: 301.42K (301419) - TotalNetworkReceiveTime: 4m3s - TotalNetworkSendTime: 8s022ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.16K (1156) - TotalThreadsTotalWallClockTime: 4m27s - TotalThreadsSysTime: 653.901ms - TotalThreadsUserTime: 7s412ms - TotalThreadsVoluntaryContextSwitches: 3.24K (3236) Fragment Instance Lifecycle Timings: - ExecTime: 1m20s - ExecTreeExecTime: 1m5s - OpenTime: 3m6s - ExecTreeOpenTime: 3m6s - PrepareTime: 162.150ms - ExecTreePrepareTime: 1.737ms KrpcDataStreamSender (dst_id=23):(Total: 2s086ms, non-child: 2s086ms, % non-child: 100.00%) - BytesSent: 44.40 MB (46556470) - OverallThroughput: 21.28 MB/sec - PeakMemoryUsage: 73.62 MB (77199104) - RowsReturned: 301.42K (301419) - RpcRetry: 0 (0) - SerializeBatchTime: 2s030ms - UncompressedRowBatchSize: 82.04 MB (86022900) CodeGen:(Total: 797.859ms, non-child: 797.859ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 215.398ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 502.199ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 78.275ms HASH_JOIN_NODE (id=11):(Total: 4m11s, non-child: 1s007ms, % non-child: 0.40%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 869.722ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.42K (301419) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.772ms - RowsReturned: 301.42K (301419) - RowsReturnedRate: 1.20 K/sec Buffer pool: - AllocTime: 130.676ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 725.047ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.082ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 30.889ms, % non-child: 0.05%) - ConvertRowBatchTime: 11.601ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.66 K/sec RecvrSide: BytesReceived(1s000ms): 496.31 KB, 1.45 MB, 2.42 MB, 3.22 MB, 4.03 MB, 6.13 MB, 8.56 MB, 9.85 MB, 11.71 MB, 15.42 MB, 20.84 MB, 23.13 MB, 25.81 MB, 28.95 MB, 31.29 MB, 33.15 MB, 34.44 MB, 35.24 MB, 37.09 MB, 38.79 MB, 40.32 MB, 42.29 MB, 43.91 MB, 46.00 MB, 48.50 MB, 50.39 MB, 51.52 MB, 53.15 MB, 54.48 MB, 55.78 MB, 56.93 MB, 57.63 MB, 58.44 MB, 58.60 MB, 59.01 MB, 59.30 MB, 59.68 MB, 59.91 MB, 60.56 MB, 60.96 MB, 61.33 MB, 61.54 MB, 61.62 MB, 61.78 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.42 MB, 62.50 MB, 62.50 MB, 62.75 MB, 62.83 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 664.259ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m10s, non-child: 53.687ms, % non-child: 0.03%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 2.185ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.23K (306231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.934ms - RowsReturned: 301.42K (301419) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1.595ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 253.392us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.344us, non-child: 14.344us, % non-child: 100.00%) - ConvertRowBatchTime: 5.690us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.51 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.341us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 8.162us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m10s, non-child: 6s485ms, % non-child: 3.41%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027582) - BuildTime: 4s799ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729027) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s365ms - RowsReturned: 306.23K (306231) - RowsReturnedRate: 1.61 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s929ms - BuildRowsPartitioned: 7.03M (7027582) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.18K (14180) - HashTablesBuildTime: 848.785ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m59s, non-child: 344.051ms, % non-child: 0.29%) - ConvertRowBatchTime: 175.481ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027582) - RowsReturnedRate: 58.81 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 6.82 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 22.32 MB, 43.04 MB, 78.51 MB, 115.99 MB, 154.15 MB, 189.61 MB, 219.68 MB, 250.18 MB, 274.41 MB, 292.48 MB, 311.93 MB, 327.22 MB, 340.43 MB, 351.63 MB, 362.76 MB, 372.28 MB, 379.07 MB, 384.18 MB, 389.18 MB, 395.24 MB, 400.50 MB, 402.74 MB, 405.46 MB, 407.62 MB, 409.49 MB, 410.74 MB, 412.07 MB, 413.03 MB, 413.95 MB, 414.21 MB, 415.18 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.53 MB (435710084) - TotalGetBatchTime: 1m59s - DataArrivalTimer: 1m59s SenderSide: - DeserializeRowBatchTime: 1s891ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 306.169ms, % non-child: 0.48%) - ConvertRowBatchTime: 140.752ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729027) - RowsReturnedRate: 89.23 K/sec RecvrSide: BytesReceived(8s000ms): 7.10 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 34.49 MB, 72.16 MB, 109.12 MB, 143.76 MB, 168.22 MB, 185.71 MB, 195.86 MB, 200.04 MB, 201.52 MB, 202.12 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.15 MB (211973999) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 2s024ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 885.590ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 1.529ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000009d (host=vc1503.foo.com:22000):(Total: 4m26s, non-child: 11s936ms, % non-child: 4.47%) MemoryUsage(8s000ms): 55.19 MB, 76.53 MB, 109.35 MB, 110.45 MB, 111.64 MB, 111.64 MB, 111.71 MB, 111.90 MB, 186.09 MB, 264.95 MB, 315.72 MB, 362.67 MB, 391.23 MB, 413.23 MB, 439.04 MB, 448.17 MB, 448.17 MB, 469.04 MB, 480.17 MB, 480.17 MB, 480.17 MB, 480.17 MB, 480.17 MB, 675.39 MB, 760.31 MB, 788.40 MB, 769.95 MB, 797.68 MB, 804.82 MB, 812.79 MB, 813.22 MB, 805.30 MB, 788.50 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 819.38 MB (859185674) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1124035145) - RowsProduced: 301.79K (301788) - TotalNetworkReceiveTime: 4m4s - TotalNetworkSendTime: 7s171ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.20K (1198) - TotalThreadsTotalWallClockTime: 4m26s - TotalThreadsSysTime: 681.896ms - TotalThreadsUserTime: 7s355ms - TotalThreadsVoluntaryContextSwitches: 3.25K (3249) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m5s - OpenTime: 3m6s - ExecTreeOpenTime: 3m6s - PrepareTime: 296.452ms - ExecTreePrepareTime: 17.206ms KrpcDataStreamSender (dst_id=23):(Total: 2s322ms, non-child: 2s322ms, % non-child: 100.00%) - BytesSent: 44.48 MB (46642793) - OverallThroughput: 19.15 MB/sec - PeakMemoryUsage: 67.69 MB (70981376) - RowsReturned: 301.79K (301788) - RpcRetry: 0 (0) - SerializeBatchTime: 2s162ms - UncompressedRowBatchSize: 82.17 MB (86160129) CodeGen:(Total: 853.425ms, non-child: 853.425ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 241.162ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 525.117ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 85.637ms HASH_JOIN_NODE (id=11):(Total: 4m11s, non-child: 743.412ms, % non-child: 0.30%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 519.956ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.79K (301788) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.499ms - RowsReturned: 301.79K (301788) - RowsReturnedRate: 1.20 K/sec Buffer pool: - AllocTime: 90.998ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 456.219ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 63.234ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 16.331ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.755ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.30 K/sec RecvrSide: BytesReceived(2s000ms): 951.23 KB, 2.70 MB, 4.88 MB, 9.73 MB, 14.65 MB, 21.86 MB, 27.54 MB, 32.30 MB, 34.72 MB, 37.94 MB, 41.39 MB, 45.12 MB, 49.37 MB, 52.24 MB, 54.89 MB, 57.15 MB, 58.36 MB, 59.03 MB, 59.64 MB, 60.68 MB, 61.31 MB, 61.66 MB, 61.86 MB, 62.10 MB, 62.34 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 425.281ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m7s, non-child: 30.685ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 598.496us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.58K (306578) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.020ms - RowsReturned: 301.79K (301788) - RowsReturnedRate: 1.61 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 71.128us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 221.467us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 13.170us, non-child: 13.170us, % non-child: 100.00%) - ConvertRowBatchTime: 5.139us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 9.26 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.281us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 7.926us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m7s, non-child: 6s523ms, % non-child: 3.48%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7030908) - BuildTime: 5s058ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727942) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s352ms - RowsReturned: 306.58K (306578) - RowsReturnedRate: 1.64 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s180ms - BuildRowsPartitioned: 7.03M (7030908) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.06K (14061) - HashTablesBuildTime: 836.764ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 242.034ms, % non-child: 0.21%) - ConvertRowBatchTime: 175.879ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7030908) - RowsReturnedRate: 60.41 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 6.99 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 31.67 MB, 76.99 MB, 113.97 MB, 152.55 MB, 187.93 MB, 218.93 MB, 250.09 MB, 275.18 MB, 294.22 MB, 312.16 MB, 327.41 MB, 340.68 MB, 352.98 MB, 362.78 MB, 373.22 MB, 379.03 MB, 384.67 MB, 389.93 MB, 395.76 MB, 400.70 MB, 402.81 MB, 405.64 MB, 407.86 MB, 409.71 MB, 410.94 MB, 412.10 MB, 413.00 MB, 414.17 MB, 414.51 MB, 415.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.72 MB (435916296) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 1s095ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 309.922ms, % non-child: 0.48%) - ConvertRowBatchTime: 135.967ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727942) - RowsReturnedRate: 89.05 K/sec RecvrSide: BytesReceived(8s000ms): 7.18 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 34.81 MB, 73.04 MB, 111.55 MB, 145.81 MB, 169.76 MB, 186.58 MB, 195.90 MB, 200.06 MB, 201.50 MB, 202.09 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.12 MB (211933854) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m4s SenderSide: - DeserializeRowBatchTime: 1s836ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 995.343ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 23.968us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000009a (host=vc1537.foo.com:22000):(Total: 4m26s, non-child: 16s809ms, % non-child: 6.31%) MemoryUsage(8s000ms): 55.37 MB, 80.23 MB, 111.40 MB, 112.15 MB, 112.84 MB, 113.70 MB, 113.96 MB, 114.07 MB, 187.74 MB, 266.21 MB, 321.05 MB, 364.71 MB, 397.49 MB, 416.43 MB, 443.93 MB, 449.05 MB, 449.43 MB, 473.24 MB, 483.24 MB, 483.43 MB, 483.43 MB, 483.43 MB, 483.43 MB, 707.15 MB, 763.98 MB, 796.66 MB, 775.91 MB, 793.27 MB, 797.77 MB, 808.39 MB, 809.73 MB, 797.29 MB, 779.91 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.01 MB (3153920) - PeakMemoryUsage: 821.80 MB (861717154) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1131715457) - RowsProduced: 300.74K (300742) - TotalNetworkReceiveTime: 3m54s - TotalNetworkSendTime: 7s377ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.26K (1257) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 609.907ms - TotalThreadsUserTime: 7s683ms - TotalThreadsVoluntaryContextSwitches: 3.92K (3917) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 59s453ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 1s023ms - ExecTreePrepareTime: 125.008ms KrpcDataStreamSender (dst_id=23):(Total: 3s732ms, non-child: 3s732ms, % non-child: 100.00%) - BytesSent: 44.28 MB (46428917) - OverallThroughput: 11.86 MB/sec - PeakMemoryUsage: 71.62 MB (75101952) - RowsReturned: 300.74K (300742) - RpcRetry: 0 (0) - SerializeBatchTime: 3s153ms - UncompressedRowBatchSize: 81.84 MB (85820568) CodeGen:(Total: 1s404ms, non-child: 1s404ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 468.391ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 669.057ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 250.733ms HASH_JOIN_NODE (id=11):(Total: 4m4s, non-child: 1s661ms, % non-child: 0.68%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s272ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.74K (300742) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.015ms - RowsReturned: 300.74K (300742) - RowsReturnedRate: 1.23 K/sec Buffer pool: - AllocTime: 103.001ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s156ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 114.539ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m1s, non-child: 26.779ms, % non-child: 0.04%) - ConvertRowBatchTime: 11.963ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.49 K/sec RecvrSide: BytesReceived(2s000ms): 1.45 MB, 3.02 MB, 5.68 MB, 10.74 MB, 16.11 MB, 21.22 MB, 27.42 MB, 32.25 MB, 34.88 MB, 37.82 MB, 42.02 MB, 45.60 MB, 50.00 MB, 52.91 MB, 55.56 MB, 57.55 MB, 58.47 MB, 59.19 MB, 59.84 MB, 60.84 MB, 61.42 MB, 61.74 MB, 61.86 MB, 62.06 MB, 62.34 MB, 62.67 MB, 62.87 MB, 62.99 MB, 63.11 MB, 63.19 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 1s467ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m, non-child: 363.607ms, % non-child: 0.20%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 228.147ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.65K (305655) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.126ms - RowsReturned: 300.74K (300742) - RowsReturnedRate: 1.66 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 205.895ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 21.829ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.082us, non-child: 14.082us, % non-child: 100.00%) - ConvertRowBatchTime: 5.038us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.66 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.853us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 20.183us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m, non-child: 7s179ms, % non-child: 3.98%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027545) - BuildTime: 5s002ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726903) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s382ms - RowsReturned: 305.65K (305655) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s834ms - BuildRowsPartitioned: 7.03M (7027545) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.14K (14144) - HashTablesBuildTime: 1s095ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m55s, non-child: 441.347ms, % non-child: 0.38%) - ConvertRowBatchTime: 171.165ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027545) - RowsReturnedRate: 61.01 K/sec RecvrSide: BytesReceived(4s000ms): 1.26 MB, 7.83 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 33.53 MB, 80.02 MB, 117.93 MB, 156.42 MB, 192.73 MB, 218.59 MB, 246.81 MB, 276.27 MB, 296.67 MB, 314.63 MB, 330.20 MB, 342.73 MB, 354.38 MB, 363.84 MB, 373.32 MB, 379.73 MB, 383.79 MB, 390.94 MB, 397.26 MB, 400.46 MB, 402.91 MB, 405.96 MB, 407.94 MB, 409.83 MB, 410.97 MB, 412.07 MB, 413.26 MB, 413.95 MB, 414.29 MB, 415.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.52 MB (435707790) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 2s887ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 42 (42) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 57s989ms, non-child: 939.132ms, % non-child: 1.62%) - ConvertRowBatchTime: 136.599ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726903) - RowsReturnedRate: 98.76 K/sec RecvrSide: BytesReceived(8s000ms): 7.65 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 36.44 MB, 73.56 MB, 111.91 MB, 145.94 MB, 170.14 MB, 186.80 MB, 196.62 MB, 200.25 MB, 201.50 MB, 202.08 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.08 MB (211895411) - TotalGetBatchTime: 57s850ms - DataArrivalTimer: 57s051ms SenderSide: - DeserializeRowBatchTime: 3s788ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 46 (46) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s512ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 227.078ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008f (host=vc1531.foo.com:22000):(Total: 4m25s, non-child: 16s965ms, % non-child: 6.38%) MemoryUsage(8s000ms): 53.29 MB, 75.19 MB, 107.23 MB, 109.55 MB, 109.97 MB, 110.16 MB, 110.16 MB, 110.16 MB, 181.40 MB, 260.61 MB, 315.48 MB, 359.67 MB, 386.17 MB, 408.50 MB, 433.42 MB, 441.42 MB, 441.47 MB, 466.03 MB, 474.92 MB, 474.92 MB, 474.92 MB, 474.92 MB, 474.92 MB, 711.45 MB, 764.38 MB, 792.19 MB, 767.99 MB, 790.41 MB, 795.97 MB, 807.11 MB, 804.80 MB, 791.49 MB, 768.34 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 815.77 MB (855400818) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1109116314) - RowsProduced: 300.64K (300636) - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 10s551ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.15K (1146) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 614.907ms - TotalThreadsUserTime: 7s721ms - TotalThreadsVoluntaryContextSwitches: 3.61K (3610) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 297.071ms - ExecTreePrepareTime: 5.264ms KrpcDataStreamSender (dst_id=23):(Total: 2s103ms, non-child: 2s103ms, % non-child: 100.00%) - BytesSent: 44.26 MB (46413846) - OverallThroughput: 21.04 MB/sec - PeakMemoryUsage: 68.61 MB (71939840) - RowsReturned: 300.64K (300636) - RpcRetry: 0 (0) - SerializeBatchTime: 1s990ms - UncompressedRowBatchSize: 81.81 MB (85784510) CodeGen:(Total: 1s075ms, non-child: 1s075ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 340.093ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 617.891ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 106.881ms HASH_JOIN_NODE (id=11):(Total: 4m5s, non-child: 798.971ms, % non-child: 0.32%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 583.904ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.64K (300636) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.027ms - RowsReturned: 300.64K (300636) - RowsReturnedRate: 1.22 K/sec Buffer pool: - AllocTime: 123.078ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 503.656ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.608ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 59.065ms, % non-child: 0.09%) - ConvertRowBatchTime: 10.992ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.29 K/sec RecvrSide: BytesReceived(2s000ms): 909.98 KB, 2.70 MB, 4.92 MB, 9.61 MB, 14.29 MB, 21.00 MB, 26.66 MB, 31.73 MB, 34.60 MB, 37.82 MB, 41.67 MB, 44.75 MB, 48.80 MB, 52.36 MB, 54.93 MB, 57.27 MB, 58.32 MB, 59.03 MB, 59.56 MB, 60.64 MB, 61.27 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.26 MB, 62.54 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 1s112ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m1s, non-child: 155.023ms, % non-child: 0.09%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 120.409ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.53K (305531) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.479ms - RowsReturned: 300.64K (300636) - RowsReturnedRate: 1.66 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 106.618ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 13.332ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 21.737us, non-child: 21.737us, % non-child: 100.00%) - ConvertRowBatchTime: 8.069us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 5.61 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 5.523us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 5.733us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m1s, non-child: 6s968ms, % non-child: 3.85%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026827) - BuildTime: 5s336ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727819) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s362ms - RowsReturned: 305.53K (305531) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s241ms - BuildRowsPartitioned: 7.03M (7026827) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.97K (13970) - HashTablesBuildTime: 1s027ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 320.131ms, % non-child: 0.28%) - ConvertRowBatchTime: 166.811ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026827) - RowsReturnedRate: 61.41 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 6.91 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 29.15 MB, 78.42 MB, 111.11 MB, 153.39 MB, 188.60 MB, 219.01 MB, 249.57 MB, 275.00 MB, 296.46 MB, 312.01 MB, 327.62 MB, 341.16 MB, 353.03 MB, 363.54 MB, 373.98 MB, 379.53 MB, 385.37 MB, 390.66 MB, 396.63 MB, 400.74 MB, 403.57 MB, 406.34 MB, 408.14 MB, 409.69 MB, 410.66 MB, 412.30 MB, 413.18 MB, 413.94 MB, 414.34 MB, 415.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.48 MB (435663274) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 2s499ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 45 (45) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 59s616ms, non-child: 1s080ms, % non-child: 1.81%) - ConvertRowBatchTime: 131.161ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727819) - RowsReturnedRate: 96.08 K/sec RecvrSide: BytesReceived(8s000ms): 7.18 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.64 MB, 72.64 MB, 110.37 MB, 145.31 MB, 169.76 MB, 186.52 MB, 196.96 MB, 200.27 MB, 201.82 MB, 202.11 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.11 MB (211929303) - TotalGetBatchTime: 59s482ms - DataArrivalTimer: 58s536ms SenderSide: - DeserializeRowBatchTime: 3s526ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 40 (40) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s185ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 119.446ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000096 (host=vc1511.foo.com:22000):(Total: 4m25s, non-child: 14s891ms, % non-child: 5.60%) MemoryUsage(8s000ms): 55.15 MB, 78.74 MB, 108.80 MB, 110.70 MB, 110.77 MB, 110.77 MB, 110.77 MB, 125.27 MB, 192.93 MB, 258.61 MB, 305.97 MB, 359.11 MB, 386.23 MB, 409.04 MB, 430.04 MB, 441.04 MB, 442.17 MB, 464.67 MB, 475.54 MB, 475.54 MB, 475.54 MB, 475.54 MB, 475.54 MB, 698.07 MB, 753.74 MB, 784.86 MB, 760.29 MB, 783.29 MB, 787.27 MB, 799.79 MB, 796.45 MB, 787.27 MB, 763.39 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.12 MB (3276800) - PeakMemoryUsage: 809.04 MB (848339538) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1095448080) - RowsProduced: 301.39K (301390) - TotalNetworkReceiveTime: 4m - TotalNetworkSendTime: 9s336ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.10K (1100) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 640.903ms - TotalThreadsUserTime: 7s430ms - TotalThreadsVoluntaryContextSwitches: 3.40K (3404) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m3s - OpenTime: 3m5s - ExecTreeOpenTime: 3m5s - PrepareTime: 513.525ms - ExecTreePrepareTime: 3.500ms KrpcDataStreamSender (dst_id=23):(Total: 1s829ms, non-child: 1s829ms, % non-child: 100.00%) - BytesSent: 44.41 MB (46566373) - OverallThroughput: 24.27 MB/sec - PeakMemoryUsage: 68.75 MB (72087296) - RowsReturned: 301.39K (301390) - RpcRetry: 0 (0) - SerializeBatchTime: 1s592ms - UncompressedRowBatchSize: 82.08 MB (86066384) CodeGen:(Total: 1s077ms, non-child: 1s077ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 335.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 511.091ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 220.084ms HASH_JOIN_NODE (id=11):(Total: 4m8s, non-child: 737.260ms, % non-child: 0.30%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 563.477ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.39K (301390) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.595ms - RowsReturned: 301.39K (301390) - RowsReturnedRate: 1.21 K/sec Buffer pool: - AllocTime: 122.567ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 409.899ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 149.531ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 20.461ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.697ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.68 K/sec RecvrSide: BytesReceived(1s000ms): 661.40 KB, 1.70 MB, 2.42 MB, 3.15 MB, 3.87 MB, 5.65 MB, 8.56 MB, 11.39 MB, 13.33 MB, 16.31 MB, 20.35 MB, 23.10 MB, 25.97 MB, 29.35 MB, 31.61 MB, 33.55 MB, 34.68 MB, 35.24 MB, 36.04 MB, 37.50 MB, 40.67 MB, 42.78 MB, 43.90 MB, 45.84 MB, 48.48 MB, 50.56 MB, 51.69 MB, 53.32 MB, 54.48 MB, 55.70 MB, 56.88 MB, 57.63 MB, 58.52 MB, 58.76 MB, 59.17 MB, 59.46 MB, 59.84 MB, 60.08 MB, 60.80 MB, 61.09 MB, 61.38 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.42 MB, 62.50 MB, 62.50 MB, 62.75 MB, 62.91 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 1s007ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m7s, non-child: 62.501ms, % non-child: 0.03%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 19.197ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.12K (306122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.138ms - RowsReturned: 301.39K (301390) - RowsReturnedRate: 1.61 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3.523ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 15.367ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.142us, non-child: 14.142us, % non-child: 100.00%) - ConvertRowBatchTime: 6.138us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.63 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 2.873us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 8.005us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m7s, non-child: 6s313ms, % non-child: 3.37%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026654) - BuildTime: 4s724ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729599) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s368ms - RowsReturned: 306.12K (306122) - RowsReturnedRate: 1.64 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s831ms - BuildRowsPartitioned: 7.03M (7026654) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.38K (14380) - HashTablesBuildTime: 871.325ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m59s, non-child: 208.553ms, % non-child: 0.18%) - ConvertRowBatchTime: 170.395ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026654) - RowsReturnedRate: 58.97 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 6.91 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 22.24 MB, 41.36 MB, 77.33 MB, 114.73 MB, 153.31 MB, 189.02 MB, 215.05 MB, 249.83 MB, 275.02 MB, 293.64 MB, 312.49 MB, 327.35 MB, 340.49 MB, 351.75 MB, 363.32 MB, 372.70 MB, 378.77 MB, 385.42 MB, 391.21 MB, 396.28 MB, 400.42 MB, 403.60 MB, 405.76 MB, 407.80 MB, 409.67 MB, 410.69 MB, 411.78 MB, 412.89 MB, 413.98 MB, 414.06 MB, 415.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.47 MB (435652548) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 2s363ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m1s, non-child: 343.182ms, % non-child: 0.56%) - ConvertRowBatchTime: 133.859ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729599) - RowsReturnedRate: 92.83 K/sec RecvrSide: BytesReceived(8s000ms): 7.02 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.04 MB, 71.13 MB, 110.28 MB, 143.17 MB, 169.96 MB, 186.14 MB, 196.72 MB, 200.13 MB, 201.64 MB, 202.17 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.17 MB (211995163) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 1s904ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 880.108ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 18.426ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000099 (host=vc1505.foo.com:22000):(Total: 4m25s, non-child: 11s781ms, % non-child: 4.43%) MemoryUsage(8s000ms): 54.15 MB, 73.06 MB, 102.07 MB, 106.77 MB, 107.26 MB, 107.73 MB, 107.76 MB, 107.76 MB, 188.34 MB, 261.92 MB, 313.93 MB, 359.29 MB, 388.67 MB, 411.84 MB, 436.82 MB, 449.42 MB, 449.42 MB, 472.36 MB, 482.42 MB, 482.42 MB, 482.42 MB, 482.42 MB, 482.42 MB, 706.88 MB, 759.46 MB, 787.58 MB, 762.53 MB, 784.35 MB, 790.76 MB, 799.23 MB, 798.47 MB, 789.37 MB, 767.78 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 808.31 MB (847569330) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1007.13 MB (1056048222) - RowsProduced: 301.46K (301458) - TotalNetworkReceiveTime: 4m3s - TotalNetworkSendTime: 7s494ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.12K (1119) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 651.901ms - TotalThreadsUserTime: 7s277ms - TotalThreadsVoluntaryContextSwitches: 3.10K (3096) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 1m5s - OpenTime: 3m6s - ExecTreeOpenTime: 3m5s - PrepareTime: 224.685ms - ExecTreePrepareTime: 1.622ms KrpcDataStreamSender (dst_id=23):(Total: 1s943ms, non-child: 1s943ms, % non-child: 100.00%) - BytesSent: 44.41 MB (46567108) - OverallThroughput: 22.85 MB/sec - PeakMemoryUsage: 66.64 MB (69875456) - RowsReturned: 301.46K (301458) - RpcRetry: 0 (0) - SerializeBatchTime: 1s847ms - UncompressedRowBatchSize: 82.12 MB (86110604) CodeGen:(Total: 726.890ms, non-child: 726.890ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 199.135ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 429.239ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 97.013ms HASH_JOIN_NODE (id=11):(Total: 4m11s, non-child: 760.350ms, % non-child: 0.30%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 628.057ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.46K (301458) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 122.995ms - RowsReturned: 301.46K (301458) - RowsReturnedRate: 1.20 K/sec Buffer pool: - AllocTime: 110.392ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 547.841ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.655ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 16.047ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.923ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.33 K/sec RecvrSide: BytesReceived(2s000ms): 868.63 KB, 2.62 MB, 4.80 MB, 9.37 MB, 14.05 MB, 21.36 MB, 26.98 MB, 31.85 MB, 34.19 MB, 37.74 MB, 41.55 MB, 44.59 MB, 49.12 MB, 52.03 MB, 54.62 MB, 57.22 MB, 58.28 MB, 59.03 MB, 59.64 MB, 60.60 MB, 61.23 MB, 61.62 MB, 61.86 MB, 62.10 MB, 62.34 MB, 62.59 MB, 62.75 MB, 62.91 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 561.880ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m7s, non-child: 35.224ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 5.443ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.24K (306241) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.598ms - RowsReturned: 301.46K (301458) - RowsReturnedRate: 1.61 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 5.046ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.933us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 10.040us, non-child: 10.040us, % non-child: 100.00%) - ConvertRowBatchTime: 3.724us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 12.15 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 2.382us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 5.205us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m7s, non-child: 7s001ms, % non-child: 3.74%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027982) - BuildTime: 5s561ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.72M (5722239) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s338ms - RowsReturned: 306.24K (306241) - RowsReturnedRate: 1.64 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s800ms - BuildRowsPartitioned: 7.03M (7027982) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.00K (14001) - HashTablesBuildTime: 743.372ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m55s, non-child: 246.681ms, % non-child: 0.21%) - ConvertRowBatchTime: 173.164ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027982) - RowsReturnedRate: 60.82 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 6.82 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 34.45 MB, 76.65 MB, 113.97 MB, 151.20 MB, 186.75 MB, 218.76 MB, 249.42 MB, 272.99 MB, 293.39 MB, 312.19 MB, 326.91 MB, 340.02 MB, 351.64 MB, 362.11 MB, 372.72 MB, 378.62 MB, 385.44 MB, 391.16 MB, 396.61 MB, 400.81 MB, 403.50 MB, 405.91 MB, 407.69 MB, 410.24 MB, 410.75 MB, 412.01 MB, 412.99 MB, 413.96 MB, 414.29 MB, 415.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.55 MB (435734884) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTime: 1s587ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 273.817ms, % non-child: 0.42%) - ConvertRowBatchTime: 132.920ms - PeakMemoryUsage: 0 - RowsReturned: 5.72M (5722239) - RowsReturnedRate: 88.59 K/sec RecvrSide: BytesReceived(8s000ms): 6.78 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.03 MB, 72.28 MB, 110.68 MB, 144.26 MB, 169.33 MB, 185.81 MB, 195.94 MB, 199.93 MB, 201.35 MB, 201.91 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 201.91 MB (211722843) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m4s SenderSide: - DeserializeRowBatchTime: 1s478ms - NumBatchesAccepted: 340 (340) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s054ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 5.010ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008d (host=vc1501.foo.com:22000):(Total: 4m25s, non-child: 18s553ms, % non-child: 6.98%) MemoryUsage(8s000ms): 53.32 MB, 77.84 MB, 108.05 MB, 111.64 MB, 112.74 MB, 112.93 MB, 112.93 MB, 126.13 MB, 194.65 MB, 260.75 MB, 312.79 MB, 358.79 MB, 383.79 MB, 411.42 MB, 434.98 MB, 445.98 MB, 446.92 MB, 469.17 MB, 479.42 MB, 479.42 MB, 479.42 MB, 479.42 MB, 479.42 MB, 704.06 MB, 754.73 MB, 786.57 MB, 770.81 MB, 786.93 MB, 792.45 MB, 800.86 MB, 798.96 MB, 791.28 MB, 763.35 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 812.76 MB (852238722) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1117483581) - RowsProduced: 300.59K (300592) - TotalNetworkReceiveTime: 3m54s - TotalNetworkSendTime: 10s305ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.18K (1175) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 684.895ms - TotalThreadsUserTime: 7s539ms - TotalThreadsVoluntaryContextSwitches: 3.81K (3809) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 58s232ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 287.543ms - ExecTreePrepareTime: 4.404ms KrpcDataStreamSender (dst_id=23):(Total: 3s196ms, non-child: 3s196ms, % non-child: 100.00%) - BytesSent: 44.25 MB (46395464) - OverallThroughput: 13.84 MB/sec - PeakMemoryUsage: 71.59 MB (75069184) - RowsReturned: 300.59K (300592) - RpcRetry: 0 (0) - SerializeBatchTime: 3s089ms - UncompressedRowBatchSize: 81.78 MB (85756182) CodeGen:(Total: 996.406ms, non-child: 996.406ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 263.241ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 602.905ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 121.016ms HASH_JOIN_NODE (id=11):(Total: 4m3s, non-child: 1s202ms, % non-child: 0.49%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 945.993ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.59K (300592) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.061ms - RowsReturned: 300.59K (300592) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 177.642ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 892.660ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.697ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 59s699ms, non-child: 52.137ms, % non-child: 0.09%) - ConvertRowBatchTime: 11.966ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.73 K/sec RecvrSide: BytesReceived(1s000ms): 991.75 KB, 1.86 MB, 2.66 MB, 3.54 MB, 4.43 MB, 6.37 MB, 9.04 MB, 11.79 MB, 14.05 MB, 17.20 MB, 21.49 MB, 23.71 MB, 26.94 MB, 29.44 MB, 31.93 MB, 33.30 MB, 34.60 MB, 35.40 MB, 36.78 MB, 38.62 MB, 41.13 MB, 43.02 MB, 44.22 MB, 46.89 MB, 48.88 MB, 50.72 MB, 52.05 MB, 53.60 MB, 54.72 MB, 56.19 MB, 57.52 MB, 58.02 MB, 58.29 MB, 58.76 MB, 59.06 MB, 59.36 MB, 59.76 MB, 60.00 MB, 60.72 MB, 61.20 MB, 61.38 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.42 MB, 62.50 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 59s686ms - DataArrivalTimer: 59s647ms SenderSide: - DeserializeRowBatchTime: 824.252ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m2s, non-child: 62.661ms, % non-child: 0.03%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 29.173ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.38K (305379) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.310ms - RowsReturned: 300.59K (300592) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 28.417ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 437.033us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.991us, non-child: 14.991us, % non-child: 100.00%) - ConvertRowBatchTime: 5.392us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.14 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.437us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 9.381us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m2s, non-child: 7s275ms, % non-child: 3.99%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.02M (7021464) - BuildTime: 5s599ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5728773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s360ms - RowsReturned: 305.38K (305379) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s573ms - BuildRowsPartitioned: 7.02M (7021464) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.34K (14342) - HashTablesBuildTime: 1s000ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 302.702ms, % non-child: 0.26%) - ConvertRowBatchTime: 175.351ms - PeakMemoryUsage: 0 - RowsReturned: 7.02M (7021464) - RowsReturnedRate: 59.49 K/sec RecvrSide: BytesReceived(4s000ms): 776.31 KB, 6.32 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 20.05 MB, 39.51 MB, 75.22 MB, 107.15 MB, 149.94 MB, 184.73 MB, 217.33 MB, 248.14 MB, 273.54 MB, 294.36 MB, 309.59 MB, 326.25 MB, 339.36 MB, 352.30 MB, 362.77 MB, 372.67 MB, 378.56 MB, 385.56 MB, 390.52 MB, 396.41 MB, 400.30 MB, 403.53 MB, 406.02 MB, 407.77 MB, 409.34 MB, 410.31 MB, 411.86 MB, 412.82 MB, 413.57 MB, 413.99 MB, 414.90 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.16 MB (435330768) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTime: 2s055ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 56s857ms, non-child: 343.429ms, % non-child: 0.60%) - ConvertRowBatchTime: 134.230ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5728773) - RowsReturnedRate: 100.75 K/sec RecvrSide: BytesReceived(8s000ms): 6.66 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 35.36 MB, 69.37 MB, 108.96 MB, 144.19 MB, 168.68 MB, 186.38 MB, 196.83 MB, 200.25 MB, 201.96 MB, 202.15 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.15 MB (211964601) - TotalGetBatchTime: 56s720ms - DataArrivalTimer: 56s514ms SenderSide: - DeserializeRowBatchTime: 1s905ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s702ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 28.250ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000098 (host=vc1508.foo.com:22000):(Total: 4m25s, non-child: 11s933ms, % non-child: 4.49%) MemoryUsage(8s000ms): 53.62 MB, 77.02 MB, 108.20 MB, 109.77 MB, 110.64 MB, 110.90 MB, 110.90 MB, 125.03 MB, 195.07 MB, 256.54 MB, 310.15 MB, 356.42 MB, 390.17 MB, 410.29 MB, 434.42 MB, 442.42 MB, 442.42 MB, 469.17 MB, 474.51 MB, 474.79 MB, 474.79 MB, 474.79 MB, 475.17 MB, 719.92 MB, 755.15 MB, 777.14 MB, 755.84 MB, 777.60 MB, 780.63 MB, 789.92 MB, 792.48 MB, 782.39 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 800.81 MB (839704962) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.01 GB (1086614005) - RowsProduced: 301.67K (301673) - TotalNetworkReceiveTime: 4m - TotalNetworkSendTime: 7s210ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.17K (1170) - TotalThreadsTotalWallClockTime: 4m25s - TotalThreadsSysTime: 616.906ms - TotalThreadsUserTime: 7s570ms - TotalThreadsVoluntaryContextSwitches: 3.49K (3486) Fragment Instance Lifecycle Timings: - ExecTime: 1m18s - ExecTreeExecTime: 1m4s - OpenTime: 3m6s - ExecTreeOpenTime: 3m5s - PrepareTime: 403.092ms - ExecTreePrepareTime: 5.880ms KrpcDataStreamSender (dst_id=23):(Total: 2s700ms, non-child: 2s700ms, % non-child: 100.00%) - BytesSent: 44.42 MB (46578926) - OverallThroughput: 16.45 MB/sec - PeakMemoryUsage: 65.64 MB (68826880) - RowsReturned: 301.67K (301673) - RpcRetry: 0 (0) - SerializeBatchTime: 2s563ms - UncompressedRowBatchSize: 82.11 MB (86102914) CodeGen:(Total: 1s080ms, non-child: 1s080ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 273.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 610.963ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 189.737ms HASH_JOIN_NODE (id=11):(Total: 4m9s, non-child: 1s517ms, % non-child: 0.61%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s347ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.67K (301673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.790ms - RowsReturned: 301.67K (301673) - RowsReturnedRate: 1.21 K/sec Buffer pool: - AllocTime: 95.027ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s300ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.852ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 59s376ms, non-child: 24.330ms, % non-child: 0.04%) - ConvertRowBatchTime: 11.864ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.77 K/sec RecvrSide: BytesReceived(1s000ms): 496.07 KB, 1.70 MB, 2.58 MB, 3.47 MB, 4.03 MB, 4.68 MB, 7.51 MB, 11.31 MB, 13.17 MB, 15.91 MB, 20.27 MB, 22.81 MB, 25.73 MB, 29.03 MB, 31.20 MB, 33.15 MB, 34.36 MB, 35.00 MB, 35.40 MB, 36.68 MB, 39.75 MB, 42.29 MB, 43.66 MB, 45.84 MB, 48.00 MB, 50.32 MB, 51.61 MB, 53.16 MB, 54.43 MB, 55.70 MB, 57.03 MB, 57.69 MB, 58.68 MB, 58.84 MB, 59.27 MB, 59.52 MB, 59.76 MB, 60.08 MB, 60.64 MB, 61.09 MB, 61.38 MB, 61.46 MB, 61.70 MB, 61.86 MB, 61.86 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.75 MB, 62.91 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 59s363ms - DataArrivalTimer: 59s352ms SenderSide: - DeserializeRowBatchTime: 436.411ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m8s, non-child: 35.672ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 576.073us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.44K (306443) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.959ms - RowsReturned: 301.67K (301673) - RowsReturnedRate: 1.60 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 164.310us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 182.024us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 9.684us, non-child: 9.684us, % non-child: 100.00%) - ConvertRowBatchTime: 3.014us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 12.60 M/sec RecvrSide: BytesReceived(1s000ms): 0, 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 2.548us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 7.788us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m8s, non-child: 7s005ms, % non-child: 3.71%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7025443) - BuildTime: 5s399ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729180) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s354ms - RowsReturned: 306.44K (306443) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s582ms - BuildRowsPartitioned: 7.03M (7025443) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.06K (14060) - HashTablesBuildTime: 799.532ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 509.693ms, % non-child: 0.43%) - ConvertRowBatchTime: 176.731ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7025443) - RowsReturnedRate: 59.19 K/sec RecvrSide: BytesReceived(4s000ms): 862.57 KB, 5.64 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 21.90 MB, 40.69 MB, 75.31 MB, 112.96 MB, 152.21 MB, 184.47 MB, 217.83 MB, 249.34 MB, 273.82 MB, 293.64 MB, 315.61 MB, 330.43 MB, 341.38 MB, 353.31 MB, 364.63 MB, 373.71 MB, 380.10 MB, 386.56 MB, 391.31 MB, 397.43 MB, 401.52 MB, 403.92 MB, 406.24 MB, 407.70 MB, 410.29 MB, 410.61 MB, 411.88 MB, 413.00 MB, 413.89 MB, 414.30 MB, 415.14 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.40 MB (435577466) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 2s025ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m3s, non-child: 489.018ms, % non-child: 0.77%) - ConvertRowBatchTime: 132.549ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729180) - RowsReturnedRate: 90.73 K/sec RecvrSide: BytesReceived(8s000ms): 6.86 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 39.55 MB, 75.55 MB, 112.37 MB, 146.51 MB, 171.03 MB, 186.96 MB, 196.71 MB, 200.37 MB, 201.68 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.16 MB (211979660) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m2s SenderSide: - DeserializeRowBatchTime: 2s962ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 773.830ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 190.934us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000091 (host=vc1535.foo.com:22000):(Total: 4m25s, non-child: 19s286ms, % non-child: 7.27%) MemoryUsage(8s000ms): 52.98 MB, 75.56 MB, 107.51 MB, 108.93 MB, 109.15 MB, 109.36 MB, 109.41 MB, 110.31 MB, 195.72 MB, 258.11 MB, 313.04 MB, 354.03 MB, 389.42 MB, 409.98 MB, 435.23 MB, 444.34 MB, 444.67 MB, 464.42 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 713.54 MB, 752.61 MB, 785.63 MB, 777.24 MB, 783.54 MB, 788.78 MB, 805.47 MB, 804.89 MB, 792.33 MB, 772.36 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 813.63 MB (853156362) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1106891155) - RowsProduced: 301.08K (301085) - TotalNetworkReceiveTime: 3m51s - TotalNetworkSendTime: 8s796ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.18K (1184) - TotalThreadsTotalWallClockTime: 4m24s - TotalThreadsSysTime: 660.900ms - TotalThreadsUserTime: 7s563ms - TotalThreadsVoluntaryContextSwitches: 3.88K (3875) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 56s440ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 484.103ms - ExecTreePrepareTime: 19.410ms KrpcDataStreamSender (dst_id=23):(Total: 3s675ms, non-child: 3s675ms, % non-child: 100.00%) - BytesSent: 44.38 MB (46539312) - OverallThroughput: 12.07 MB/sec - PeakMemoryUsage: 69.59 MB (72972032) - RowsReturned: 301.08K (301085) - RpcRetry: 0 (0) - SerializeBatchTime: 3s480ms - UncompressedRowBatchSize: 81.99 MB (85971285) CodeGen:(Total: 1s245ms, non-child: 1s245ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 362.778ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 671.771ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 208.834ms HASH_JOIN_NODE (id=11):(Total: 4m1s, non-child: 1s430ms, % non-child: 0.59%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s082ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.08K (301085) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.456ms - RowsReturned: 301.08K (301085) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 67.795ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s027ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 54.402ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m1s, non-child: 32.868ms, % non-child: 0.05%) - ConvertRowBatchTime: 11.690ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.53 K/sec RecvrSide: BytesReceived(2s000ms): 1.05 MB, 2.90 MB, 5.16 MB, 8.11 MB, 14.21 MB, 22.24 MB, 27.82 MB, 32.38 MB, 34.72 MB, 37.09 MB, 41.06 MB, 43.71 MB, 48.76 MB, 52.29 MB, 55.01 MB, 57.39 MB, 58.56 MB, 59.26 MB, 59.76 MB, 60.68 MB, 61.29 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.42 MB, 62.63 MB, 62.87 MB, 63.11 MB, 63.27 MB, 63.33 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 975.505ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m58s, non-child: 181.581ms, % non-child: 0.10%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 133.738ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.82K (305818) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.563ms - RowsReturned: 301.08K (301085) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 106.714ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 26.188ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 17.329us, non-child: 17.329us, % non-child: 100.00%) - ConvertRowBatchTime: 7.263us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.04 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.026us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.483us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m57s, non-child: 7s948ms, % non-child: 4.47%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7029018) - BuildTime: 6s282ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5725521) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s384ms - RowsReturned: 305.82K (305818) - RowsReturnedRate: 1.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 5s209ms - BuildRowsPartitioned: 7.03M (7029018) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.12K (14120) - HashTablesBuildTime: 990.260ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 456.974ms, % non-child: 0.40%) - ConvertRowBatchTime: 167.061ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7029018) - RowsReturnedRate: 61.13 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.41 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 40.94 MB, 79.77 MB, 116.67 MB, 145.64 MB, 186.33 MB, 221.12 MB, 252.40 MB, 271.68 MB, 295.76 MB, 314.35 MB, 328.21 MB, 340.27 MB, 353.80 MB, 363.53 MB, 372.48 MB, 380.41 MB, 386.84 MB, 391.11 MB, 396.46 MB, 400.78 MB, 404.04 MB, 406.64 MB, 408.38 MB, 410.26 MB, 410.72 MB, 412.04 MB, 413.50 MB, 414.01 MB, 414.58 MB, 415.30 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.61 MB (435799116) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 4s268ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 55s050ms, non-child: 459.556ms, % non-child: 0.83%) - ConvertRowBatchTime: 138.018ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5725521) - RowsReturnedRate: 104.00 K/sec RecvrSide: BytesReceived(8s000ms): 7.14 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.75 MB, 71.05 MB, 110.20 MB, 143.38 MB, 170.06 MB, 187.14 MB, 196.83 MB, 200.32 MB, 201.62 MB, 202.03 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.03 MB (211844277) - TotalGetBatchTime: 54s909ms - DataArrivalTimer: 54s590ms SenderSide: - DeserializeRowBatchTime: 1s980ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 54 (54) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s562ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 132.347ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000084 (host=vc1524.foo.com:22000):(Total: 4m24s, non-child: 19s321ms, % non-child: 7.29%) MemoryUsage(8s000ms): 53.00 MB, 79.92 MB, 109.07 MB, 109.82 MB, 110.63 MB, 110.63 MB, 110.63 MB, 110.63 MB, 190.32 MB, 256.14 MB, 316.48 MB, 359.48 MB, 388.67 MB, 406.73 MB, 434.04 MB, 441.17 MB, 441.17 MB, 465.54 MB, 473.17 MB, 473.17 MB, 473.17 MB, 473.17 MB, 493.17 MB, 729.49 MB, 757.29 MB, 784.48 MB, 762.05 MB, 785.01 MB, 787.76 MB, 798.61 MB, 799.86 MB, 782.93 MB, 759.24 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 815.81 MB (855433602) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1098632457) - RowsProduced: 300.96K (300965) - TotalNetworkReceiveTime: 3m51s - TotalNetworkSendTime: 13s717ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.11K (1111) - TotalThreadsTotalWallClockTime: 4m23s - TotalThreadsSysTime: 623.905ms - TotalThreadsUserTime: 7s520ms - TotalThreadsVoluntaryContextSwitches: 3.55K (3553) Fragment Instance Lifecycle Timings: - ExecTime: 1m19s - ExecTreeExecTime: 58s391ms - OpenTime: 3m3s - ExecTreeOpenTime: 3m2s - PrepareTime: 1s767ms - ExecTreePrepareTime: 143.583ms KrpcDataStreamSender (dst_id=23):(Total: 3s303ms, non-child: 3s303ms, % non-child: 100.00%) - BytesSent: 44.31 MB (46464905) - OverallThroughput: 13.41 MB/sec - PeakMemoryUsage: 73.64 MB (77215488) - RowsReturned: 300.96K (300965) - RpcRetry: 0 (0) - SerializeBatchTime: 2s078ms - UncompressedRowBatchSize: 81.93 MB (85913245) CodeGen:(Total: 1s256ms, non-child: 1s256ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 293.834ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 595.874ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 360.079ms HASH_JOIN_NODE (id=11):(Total: 4m, non-child: 1s846ms, % non-child: 0.77%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s651ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.96K (300965) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.282ms - RowsReturned: 300.96K (300965) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 140.059ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s539ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 111.225ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 35.697ms, % non-child: 0.06%) - ConvertRowBatchTime: 11.860ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.60 K/sec RecvrSide: BytesReceived(2s000ms): 1.13 MB, 3.55 MB, 6.33 MB, 11.27 MB, 16.59 MB, 23.47 MB, 29.11 MB, 33.39 MB, 35.73 MB, 38.91 MB, 43.03 MB, 46.20 MB, 49.58 MB, 52.87 MB, 55.95 MB, 57.87 MB, 58.71 MB, 59.23 MB, 59.84 MB, 60.84 MB, 61.42 MB, 61.74 MB, 61.94 MB, 62.14 MB, 62.34 MB, 62.67 MB, 62.87 MB, 62.99 MB, 63.11 MB, 63.19 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 761.271ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 2 (2) - NumEarlySenders: 2 (2) HASH_JOIN_NODE (id=10):(Total: 2m58s, non-child: 275.306ms, % non-child: 0.15%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 81.846ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.72K (305719) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.838ms - RowsReturned: 300.96K (300965) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 81.078ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 281.954us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 23.544us, non-child: 23.544us, % non-child: 100.00%) - ConvertRowBatchTime: 12.281us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 5.18 M/sec RecvrSide: BytesReceived(2s000ms): 1.88 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.779us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.541us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m57s, non-child: 6s775ms, % non-child: 3.81%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7028236) - BuildTime: 5s127ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5730820) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s327ms - RowsReturned: 305.72K (305719) - RowsReturnedRate: 1.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s100ms - BuildRowsPartitioned: 7.03M (7028236) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.92K (13923) - HashTablesBuildTime: 1s002ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 238.462ms, % non-child: 0.21%) - ConvertRowBatchTime: 175.027ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7028236) - RowsReturnedRate: 61.61 K/sec RecvrSide: BytesReceived(4s000ms): 1.68 MB, 8.34 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 37.82 MB, 83.06 MB, 117.84 MB, 155.58 MB, 193.49 MB, 223.56 MB, 253.07 MB, 279.57 MB, 299.43 MB, 313.15 MB, 326.11 MB, 343.18 MB, 354.84 MB, 365.90 MB, 375.15 MB, 381.76 MB, 386.82 MB, 392.03 MB, 397.84 MB, 402.35 MB, 404.88 MB, 407.12 MB, 408.72 MB, 410.18 MB, 410.94 MB, 412.52 MB, 413.43 MB, 413.94 MB, 414.97 MB, 415.30 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.56 MB (435750632) - TotalGetBatchTime: 1m53s - DataArrivalTimer: 1m53s SenderSide: - DeserializeRowBatchTime: 1s650ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 43 (43) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 57s097ms, non-child: 429.850ms, % non-child: 0.75%) - ConvertRowBatchTime: 128.784ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5730820) - RowsReturnedRate: 100.37 K/sec RecvrSide: BytesReceived(8s000ms): 7.65 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 43.58 MB, 74.24 MB, 113.57 MB, 146.95 MB, 171.41 MB, 188.51 MB, 197.61 MB, 201.07 MB, 202.18 MB, 202.22 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.22 MB (212040340) - TotalGetBatchTime: 56s965ms - DataArrivalTimer: 56s667ms SenderSide: - DeserializeRowBatchTime: 2s590ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 750.560ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 80.893ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000095 (host=vc1502.foo.com:22000):(Total: 4m24s, non-child: 11s721ms, % non-child: 4.43%) MemoryUsage(8s000ms): 56.62 MB, 75.48 MB, 106.24 MB, 107.95 MB, 108.99 MB, 109.59 MB, 109.68 MB, 110.10 MB, 182.18 MB, 259.37 MB, 311.61 MB, 358.23 MB, 388.92 MB, 410.67 MB, 437.07 MB, 446.67 MB, 446.67 MB, 469.86 MB, 479.67 MB, 479.67 MB, 479.67 MB, 479.67 MB, 479.67 MB, 703.12 MB, 762.35 MB, 784.72 MB, 761.32 MB, 786.85 MB, 791.70 MB, 800.65 MB, 799.33 MB, 791.17 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 805.54 MB (844669338) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1091038268) - RowsProduced: 302.24K (302238) - TotalNetworkReceiveTime: 4m3s - TotalNetworkSendTime: 8s119ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.16K (1155) - TotalThreadsTotalWallClockTime: 4m24s - TotalThreadsSysTime: 644.902ms - TotalThreadsUserTime: 7s401ms - TotalThreadsVoluntaryContextSwitches: 3.16K (3158) Fragment Instance Lifecycle Timings: - ExecTime: 1m18s - ExecTreeExecTime: 1m5s - OpenTime: 3m5s - ExecTreeOpenTime: 3m5s - PrepareTime: 321.192ms - ExecTreePrepareTime: 8.172ms KrpcDataStreamSender (dst_id=23):(Total: 1s240ms, non-child: 1s240ms, % non-child: 100.00%) - BytesSent: 44.53 MB (46696171) - OverallThroughput: 35.89 MB/sec - PeakMemoryUsage: 64.62 MB (67761920) - RowsReturned: 302.24K (302238) - RpcRetry: 0 (0) - SerializeBatchTime: 1s136ms - UncompressedRowBatchSize: 82.27 MB (86270915) CodeGen:(Total: 916.821ms, non-child: 916.821ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 244.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 527.277ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 124.077ms HASH_JOIN_NODE (id=11):(Total: 4m10s, non-child: 893.612ms, % non-child: 0.36%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 742.769ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.24K (302238) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.568ms - RowsReturned: 302.24K (302238) - RowsReturnedRate: 1.21 K/sec Buffer pool: - AllocTime: 117.842ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 639.859ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 102.305ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 15.577ms, % non-child: 0.02%) - ConvertRowBatchTime: 11.616ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.29 K/sec RecvrSide: BytesReceived(2s000ms): 992.03 KB, 2.78 MB, 4.80 MB, 9.45 MB, 14.41 MB, 21.32 MB, 27.50 MB, 32.22 MB, 34.64 MB, 37.74 MB, 41.63 MB, 44.47 MB, 49.31 MB, 52.18 MB, 54.73 MB, 57.25 MB, 58.49 MB, 59.07 MB, 59.60 MB, 60.64 MB, 61.31 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.22 MB, 62.54 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 474.513ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m5s, non-child: 43.878ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 947.592us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 307.09K (307086) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.215ms - RowsReturned: 302.24K (302238) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 393.378us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 228.233us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 13.742us, non-child: 13.742us, % non-child: 100.00%) - ConvertRowBatchTime: 4.697us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.88 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.849us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 12.239us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m5s, non-child: 6s269ms, % non-child: 3.37%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7028528) - BuildTime: 4s820ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727963) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s352ms - RowsReturned: 307.09K (307086) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s965ms - BuildRowsPartitioned: 7.03M (7028528) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.16K (14157) - HashTablesBuildTime: 815.502ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m55s, non-child: 290.007ms, % non-child: 0.25%) - ConvertRowBatchTime: 179.326ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7028528) - RowsReturnedRate: 60.94 K/sec RecvrSide: BytesReceived(4s000ms): 862.57 KB, 7.08 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 29.82 MB, 77.07 MB, 113.46 MB, 154.57 MB, 189.95 MB, 219.01 MB, 250.43 MB, 274.97 MB, 295.40 MB, 313.50 MB, 329.02 MB, 341.49 MB, 353.22 MB, 363.06 MB, 373.68 MB, 379.33 MB, 386.26 MB, 391.44 MB, 396.70 MB, 401.09 MB, 403.84 MB, 405.96 MB, 408.13 MB, 409.96 MB, 410.82 MB, 412.08 MB, 413.17 MB, 414.09 MB, 414.26 MB, 415.35 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.58 MB (435768736) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTime: 1s039ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 40 (40) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m4s, non-child: 231.605ms, % non-child: 0.36%) - ConvertRowBatchTime: 134.678ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727963) - RowsReturnedRate: 89.06 K/sec RecvrSide: BytesReceived(8s000ms): 7.10 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.04 MB, 72.88 MB, 110.40 MB, 143.70 MB, 169.96 MB, 186.03 MB, 196.63 MB, 200.16 MB, 201.63 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.12 MB (211934631) - TotalGetBatchTime: 1m4s - DataArrivalTimer: 1m4s SenderSide: - DeserializeRowBatchTime: 1s549ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s042ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 341.069us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000093 (host=vc1507.foo.com:22000):(Total: 4m22s, non-child: 15s429ms, % non-child: 5.87%) MemoryUsage(8s000ms): 42.69 MB, 79.93 MB, 111.82 MB, 116.69 MB, 117.66 MB, 117.66 MB, 117.66 MB, 117.66 MB, 184.92 MB, 261.87 MB, 313.42 MB, 357.61 MB, 385.42 MB, 406.92 MB, 431.17 MB, 439.01 MB, 441.37 MB, 464.67 MB, 475.79 MB, 476.65 MB, 477.04 MB, 477.79 MB, 478.04 MB, 703.11 MB, 756.55 MB, 785.21 MB, 776.74 MB, 788.23 MB, 791.88 MB, 800.83 MB, 808.45 MB, 798.62 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 811.10 MB (850502090) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1103235426) - RowsProduced: 300.95K (300954) - TotalNetworkReceiveTime: 3m50s - TotalNetworkSendTime: 6s554ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.22K (1220) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 695.894ms - TotalThreadsUserTime: 7s747ms - TotalThreadsVoluntaryContextSwitches: 3.99K (3994) Fragment Instance Lifecycle Timings: - ExecTime: 1m17s - ExecTreeExecTime: 58s858ms - OpenTime: 3m2s - ExecTreeOpenTime: 3m1s - PrepareTime: 3s179ms - ExecTreePrepareTime: 36.207ms KrpcDataStreamSender (dst_id=23):(Total: 4s720ms, non-child: 4s720ms, % non-child: 100.00%) - BytesSent: 44.30 MB (46452164) - OverallThroughput: 9.38 MB/sec - PeakMemoryUsage: 72.69 MB (76216064) - RowsReturned: 300.95K (300954) - RpcRetry: 0 (0) - SerializeBatchTime: 2s939ms - UncompressedRowBatchSize: 81.88 MB (85859295) CodeGen:(Total: 2s436ms, non-child: 2s436ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 331.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 833.401ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 1s239ms HASH_JOIN_NODE (id=11):(Total: 4m, non-child: 1s690ms, % non-child: 0.70%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s276ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.95K (300954) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.073ms - RowsReturned: 300.95K (300954) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 498.724ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s084ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 191.119ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 59s675ms, non-child: 51.707ms, % non-child: 0.09%) - ConvertRowBatchTime: 11.303ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.74 K/sec RecvrSide: BytesReceived(2s000ms): 744.33 KB, 2.34 MB, 5.56 MB, 10.21 MB, 14.98 MB, 21.93 MB, 27.58 MB, 31.77 MB, 34.23 MB, 37.98 MB, 41.86 MB, 45.00 MB, 49.39 MB, 52.22 MB, 55.13 MB, 57.30 MB, 58.44 MB, 59.11 MB, 59.68 MB, 60.76 MB, 61.31 MB, 61.66 MB, 61.86 MB, 62.10 MB, 62.38 MB, 62.63 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 59s662ms - DataArrivalTimer: 59s623ms SenderSide: - DeserializeRowBatchTime: 1s480ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m59s, non-child: 144.119ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 89.914ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.76K (305756) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.490ms - RowsReturned: 300.95K (300954) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 89.234ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 240.309us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.521us, non-child: 14.521us, % non-child: 100.00%) - ConvertRowBatchTime: 4.531us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.40 M/sec RecvrSide: BytesReceived(2s000ms): 0, 1.88 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.558us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 6.115us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m58s, non-child: 7s410ms, % non-child: 4.14%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027680) - BuildTime: 5s862ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.72M (5724614) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s372ms - RowsReturned: 305.76K (305756) - RowsReturnedRate: 1.71 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s965ms - BuildRowsPartitioned: 7.03M (7027680) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.97K (13969) - HashTablesBuildTime: 862.082ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 313.482ms, % non-child: 0.27%) - ConvertRowBatchTime: 171.314ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027680) - RowsReturnedRate: 61.64 K/sec RecvrSide: BytesReceived(4s000ms): 517.54 KB, 7.50 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 30.75 MB, 77.58 MB, 116.41 MB, 155.41 MB, 190.54 MB, 220.61 MB, 252.58 MB, 275.75 MB, 295.45 MB, 313.66 MB, 328.74 MB, 341.12 MB, 353.97 MB, 362.68 MB, 373.44 MB, 378.98 MB, 386.07 MB, 390.62 MB, 396.79 MB, 401.43 MB, 403.95 MB, 406.23 MB, 408.24 MB, 410.21 MB, 410.83 MB, 412.08 MB, 413.34 MB, 413.93 MB, 414.18 MB, 415.25 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.53 MB (435716160) - TotalGetBatchTime: 1m53s - DataArrivalTimer: 1m53s SenderSide: - DeserializeRowBatchTime: 1s555ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 40 (40) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 57s471ms, non-child: 440.059ms, % non-child: 0.77%) - ConvertRowBatchTime: 136.108ms - PeakMemoryUsage: 0 - RowsReturned: 5.72M (5724614) - RowsReturnedRate: 99.61 K/sec RecvrSide: BytesReceived(8s000ms): 6.50 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.32 MB, 72.60 MB, 110.82 MB, 144.85 MB, 170.13 MB, 186.51 MB, 196.58 MB, 200.21 MB, 201.56 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.00 MB (211810718) - TotalGetBatchTime: 57s332ms - DataArrivalTimer: 57s032ms SenderSide: - DeserializeRowBatchTime: 3s406ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 37 (37) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s515ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 89.075ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008e (host=vc1533.foo.com:22000):(Total: 4m21s, non-child: 13s105ms, % non-child: 5.00%) MemoryUsage(8s000ms): 56.21 MB, 75.70 MB, 104.63 MB, 107.85 MB, 109.38 MB, 109.38 MB, 109.38 MB, 126.41 MB, 194.57 MB, 260.47 MB, 315.35 MB, 355.63 MB, 389.36 MB, 410.68 MB, 436.36 MB, 443.68 MB, 443.68 MB, 465.18 MB, 475.68 MB, 475.68 MB, 475.68 MB, 475.68 MB, 475.68 MB, 714.59 MB, 747.92 MB, 782.92 MB, 771.10 MB, 785.56 MB, 792.26 MB, 801.09 MB, 792.97 MB, 780.76 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.01 MB (3153920) - PeakMemoryUsage: 808.64 MB (847921858) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1091194444) - RowsProduced: 302.33K (302328) - TotalNetworkReceiveTime: 3m56s - TotalNetworkSendTime: 5s838ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.09K (1091) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 618.906ms - TotalThreadsUserTime: 7s323ms - TotalThreadsVoluntaryContextSwitches: 3.53K (3526) Fragment Instance Lifecycle Timings: - ExecTime: 1m15s - ExecTreeExecTime: 59s424ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m5s - PrepareTime: 281.877ms - ExecTreePrepareTime: 11.085ms KrpcDataStreamSender (dst_id=23):(Total: 3s499ms, non-child: 3s499ms, % non-child: 100.00%) - BytesSent: 44.54 MB (46708442) - OverallThroughput: 12.73 MB/sec - PeakMemoryUsage: 71.64 MB (75118336) - RowsReturned: 302.33K (302328) - RpcRetry: 0 (0) - SerializeBatchTime: 3s370ms - UncompressedRowBatchSize: 82.30 MB (86293292) CodeGen:(Total: 859.094ms, non-child: 859.094ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 260.230ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 501.114ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 93.254ms HASH_JOIN_NODE (id=11):(Total: 4m4s, non-child: 1s067ms, % non-child: 0.44%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 927.429ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.33K (302328) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.336ms - RowsReturned: 302.33K (302328) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 475.933ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 880.341ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.432ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 33.595ms, % non-child: 0.06%) - ConvertRowBatchTime: 12.188ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.69 K/sec RecvrSide: BytesReceived(1s000ms): 661.40 KB, 1.62 MB, 2.42 MB, 2.74 MB, 3.95 MB, 6.13 MB, 8.48 MB, 10.98 MB, 13.08 MB, 15.98 MB, 20.43 MB, 22.96 MB, 25.57 MB, 28.87 MB, 31.37 MB, 33.23 MB, 33.95 MB, 35.16 MB, 36.85 MB, 38.47 MB, 40.56 MB, 42.54 MB, 43.75 MB, 45.84 MB, 48.18 MB, 50.48 MB, 51.52 MB, 53.24 MB, 54.56 MB, 55.62 MB, 56.93 MB, 57.63 MB, 58.44 MB, 58.60 MB, 59.09 MB, 59.30 MB, 59.68 MB, 59.91 MB, 60.64 MB, 60.96 MB, 61.33 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.67 MB, 62.83 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 526.667ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m3s, non-child: 40.156ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 474.260us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 307.16K (307160) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.491ms - RowsReturned: 302.33K (302328) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 60.100us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 124.848us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 13.394us, non-child: 13.394us, % non-child: 100.00%) - ConvertRowBatchTime: 4.064us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 9.11 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.514us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 7.684us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m3s, non-child: 6s745ms, % non-child: 3.68%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7030364) - BuildTime: 5s198ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729358) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s335ms - RowsReturned: 307.16K (307160) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s285ms - BuildRowsPartitioned: 7.03M (7030364) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.29K (14292) - HashTablesBuildTime: 877.305ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 310.585ms, % non-child: 0.26%) - ConvertRowBatchTime: 174.596ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7030364) - RowsReturnedRate: 59.34 K/sec RecvrSide: BytesReceived(4s000ms): 776.31 KB, 7.16 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 21.90 MB, 39.93 MB, 77.83 MB, 114.73 MB, 152.72 MB, 188.60 MB, 219.77 MB, 249.66 MB, 271.76 MB, 296.24 MB, 312.85 MB, 327.42 MB, 340.36 MB, 353.53 MB, 361.75 MB, 373.69 MB, 380.14 MB, 385.19 MB, 390.86 MB, 396.67 MB, 401.40 MB, 403.83 MB, 406.62 MB, 408.49 MB, 409.86 MB, 411.07 MB, 412.44 MB, 413.46 MB, 414.05 MB, 414.63 MB, 415.37 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.69 MB (435882568) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 1s725ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s092ms, non-child: 309.962ms, % non-child: 0.53%) - ConvertRowBatchTime: 134.974ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729358) - RowsReturnedRate: 98.62 K/sec RecvrSide: BytesReceived(8s000ms): 6.98 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.51 MB, 70.13 MB, 110.78 MB, 144.37 MB, 170.16 MB, 186.79 MB, 196.90 MB, 200.21 MB, 201.90 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.17 MB (211986246) - TotalGetBatchTime: 57s954ms - DataArrivalTimer: 57s782ms SenderSide: - DeserializeRowBatchTime: 1s920ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s308ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 5.925us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008c (host=vc1522.foo.com:22000):(Total: 4m21s, non-child: 13s666ms, % non-child: 5.22%) MemoryUsage(8s000ms): 53.95 MB, 74.51 MB, 106.28 MB, 108.79 MB, 110.16 MB, 110.63 MB, 110.67 MB, 110.67 MB, 177.45 MB, 259.73 MB, 310.17 MB, 357.98 MB, 388.56 MB, 409.42 MB, 432.54 MB, 441.42 MB, 441.42 MB, 461.42 MB, 473.84 MB, 475.78 MB, 476.54 MB, 476.54 MB, 476.54 MB, 707.32 MB, 750.11 MB, 779.26 MB, 755.85 MB, 777.06 MB, 782.45 MB, 793.88 MB, 793.21 MB, 778.91 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 806.57 MB (845750682) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1016.83 MB (1066228067) - RowsProduced: 301.48K (301482) - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 9s078ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.22K (1224) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 683.896ms - TotalThreadsUserTime: 7s237ms - TotalThreadsVoluntaryContextSwitches: 3.52K (3523) Fragment Instance Lifecycle Timings: - ExecTime: 1m16s - ExecTreeExecTime: 59s090ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 261.221ms - ExecTreePrepareTime: 3.827ms KrpcDataStreamSender (dst_id=23):(Total: 3s383ms, non-child: 3s383ms, % non-child: 100.00%) - BytesSent: 44.41 MB (46565478) - OverallThroughput: 13.13 MB/sec - PeakMemoryUsage: 71.65 MB (75134720) - RowsReturned: 301.48K (301482) - RpcRetry: 0 (0) - SerializeBatchTime: 3s285ms - UncompressedRowBatchSize: 82.07 MB (86057417) CodeGen:(Total: 869.728ms, non-child: 869.728ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 219.856ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 487.009ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 162.005ms HASH_JOIN_NODE (id=11):(Total: 4m3s, non-child: 1s194ms, % non-child: 0.49%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 936.757ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.48K (301482) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.814ms - RowsReturned: 301.48K (301482) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 74.807ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 875.482ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.698ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 41.911ms, % non-child: 0.07%) - ConvertRowBatchTime: 11.837ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.30 K/sec RecvrSide: BytesReceived(2s000ms): 827.42 KB, 2.66 MB, 4.88 MB, 8.68 MB, 14.05 MB, 21.17 MB, 26.69 MB, 31.69 MB, 34.80 MB, 36.93 MB, 40.68 MB, 44.43 MB, 48.68 MB, 52.11 MB, 54.81 MB, 57.05 MB, 58.16 MB, 59.03 MB, 59.60 MB, 60.52 MB, 61.23 MB, 61.62 MB, 61.82 MB, 62.06 MB, 62.34 MB, 62.59 MB, 62.79 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 534.109ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m59s, non-child: 34.570ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 4.030ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.28K (306280) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.270ms - RowsReturned: 301.48K (301482) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3.417ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 325.030us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 13.461us, non-child: 13.461us, % non-child: 100.00%) - ConvertRowBatchTime: 4.618us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 9.06 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.298us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 4.715us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m58s, non-child: 6s456ms, % non-child: 3.61%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027963) - BuildTime: 4s846ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729060) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s351ms - RowsReturned: 306.28K (306280) - RowsReturnedRate: 1.71 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s039ms - BuildRowsPartitioned: 7.03M (7027963) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.22K (14219) - HashTablesBuildTime: 787.634ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 219.489ms, % non-child: 0.19%) - ConvertRowBatchTime: 167.407ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027963) - RowsReturnedRate: 61.22 K/sec RecvrSide: BytesReceived(4s000ms): 776.31 KB, 6.32 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 29.15 MB, 75.90 MB, 112.79 MB, 152.80 MB, 185.57 MB, 216.99 MB, 249.57 MB, 274.72 MB, 293.61 MB, 312.93 MB, 327.11 MB, 339.88 MB, 352.68 MB, 362.97 MB, 373.67 MB, 379.33 MB, 385.62 MB, 390.95 MB, 396.09 MB, 401.27 MB, 403.83 MB, 406.20 MB, 408.24 MB, 409.77 MB, 410.73 MB, 412.35 MB, 413.29 MB, 413.96 MB, 414.37 MB, 415.26 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.55 MB (435733706) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 1s426ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 57s721ms, non-child: 322.747ms, % non-child: 0.56%) - ConvertRowBatchTime: 134.309ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729060) - RowsReturnedRate: 99.25 K/sec RecvrSide: BytesReceived(8s000ms): 6.86 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 36.80 MB, 71.33 MB, 108.59 MB, 144.07 MB, 169.44 MB, 186.19 MB, 196.99 MB, 200.27 MB, 202.01 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.16 MB (211975220) - TotalGetBatchTime: 57s584ms - DataArrivalTimer: 57s399ms SenderSide: - DeserializeRowBatchTime: 1s988ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 876.798ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 3.402ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000088 (host=vc1541.foo.com:22000):(Total: 4m21s, non-child: 16s555ms, % non-child: 6.32%) MemoryUsage(8s000ms): 46.89 MB, 73.32 MB, 103.99 MB, 107.04 MB, 108.38 MB, 108.54 MB, 108.64 MB, 119.48 MB, 192.97 MB, 256.17 MB, 307.92 MB, 352.45 MB, 389.36 MB, 409.73 MB, 435.53 MB, 443.42 MB, 443.42 MB, 466.23 MB, 477.04 MB, 477.42 MB, 477.42 MB, 477.42 MB, 477.42 MB, 713.75 MB, 751.96 MB, 778.92 MB, 762.34 MB, 776.60 MB, 781.51 MB, 793.45 MB, 784.88 MB, 765.77 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 800.06 MB (838918602) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1099305038) - RowsProduced: 301.92K (301920) - TotalNetworkReceiveTime: 3m51s - TotalNetworkSendTime: 9s523ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.20K (1198) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 698.894ms - TotalThreadsUserTime: 7s610ms - TotalThreadsVoluntaryContextSwitches: 3.74K (3743) Fragment Instance Lifecycle Timings: - ExecTime: 1m15s - ExecTreeExecTime: 56s610ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m3s - PrepareTime: 520.388ms - ExecTreePrepareTime: 60.624ms KrpcDataStreamSender (dst_id=23):(Total: 2s892ms, non-child: 2s892ms, % non-child: 100.00%) - BytesSent: 44.48 MB (46635832) - OverallThroughput: 15.38 MB/sec - PeakMemoryUsage: 65.64 MB (68826880) - RowsReturned: 301.92K (301920) - RpcRetry: 0 (0) - SerializeBatchTime: 2s675ms - UncompressedRowBatchSize: 82.20 MB (86189415) CodeGen:(Total: 1s727ms, non-child: 1s727ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 970.961ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 563.109ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 191.575ms HASH_JOIN_NODE (id=11):(Total: 4m, non-child: 1s018ms, % non-child: 0.42%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 807.127ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.92K (301920) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.616ms - RowsReturned: 301.92K (301920) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 184.877ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 631.128ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 175.222ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 59s293ms, non-child: 18.393ms, % non-child: 0.03%) - ConvertRowBatchTime: 12.055ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.78 K/sec RecvrSide: BytesReceived(1s000ms): 248.15 KB, 1.61 MB, 2.34 MB, 3.06 MB, 4.11 MB, 5.81 MB, 8.24 MB, 11.06 MB, 13.17 MB, 15.50 MB, 20.03 MB, 22.40 MB, 25.00 MB, 28.71 MB, 30.80 MB, 32.98 MB, 34.27 MB, 35.24 MB, 36.69 MB, 38.46 MB, 40.24 MB, 42.49 MB, 43.83 MB, 45.84 MB, 47.94 MB, 50.31 MB, 51.36 MB, 53.06 MB, 54.32 MB, 55.54 MB, 56.82 MB, 57.70 MB, 58.18 MB, 58.60 MB, 59.19 MB, 59.36 MB, 59.52 MB, 59.83 MB, 60.40 MB, 60.96 MB, 61.33 MB, 61.46 MB, 61.70 MB, 61.86 MB, 61.94 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.67 MB, 62.91 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 59s279ms - DataArrivalTimer: 59s275ms SenderSide: - DeserializeRowBatchTime: 900.446ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m, non-child: 327.829ms, % non-child: 0.18%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 246.675ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.73K (306731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.570ms - RowsReturned: 301.92K (301920) - RowsReturnedRate: 1.67 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 245.986ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 325.990us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 19.749us, non-child: 19.749us, % non-child: 100.00%) - ConvertRowBatchTime: 6.873us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.18 M/sec RecvrSide: BytesReceived(1s000ms): 0, 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 5.366us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 15.873us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m, non-child: 7s077ms, % non-child: 3.93%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027437) - BuildTime: 5s289ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5725245) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s349ms - RowsReturned: 306.73K (306731) - RowsReturnedRate: 1.70 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s182ms - BuildRowsPartitioned: 7.03M (7027437) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.23K (14229) - HashTablesBuildTime: 1s077ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m57s, non-child: 264.470ms, % non-child: 0.22%) - ConvertRowBatchTime: 171.850ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027437) - RowsReturnedRate: 59.77 K/sec RecvrSide: BytesReceived(4s000ms): 517.54 KB, 6.74 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 18.53 MB, 39.42 MB, 75.98 MB, 112.71 MB, 149.60 MB, 187.09 MB, 218.08 MB, 247.13 MB, 272.32 MB, 295.85 MB, 312.65 MB, 324.28 MB, 339.46 MB, 353.71 MB, 362.88 MB, 373.00 MB, 379.87 MB, 386.54 MB, 391.09 MB, 396.64 MB, 401.71 MB, 403.84 MB, 406.89 MB, 408.41 MB, 410.30 MB, 410.72 MB, 412.36 MB, 413.34 MB, 413.93 MB, 414.65 MB, 415.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.52 MB (435701094) - TotalGetBatchTime: 1m57s - DataArrivalTimer: 1m57s SenderSide: - DeserializeRowBatchTime: 1s943ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 55s358ms, non-child: 585.392ms, % non-child: 1.06%) - ConvertRowBatchTime: 134.439ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5725245) - RowsReturnedRate: 103.42 K/sec RecvrSide: BytesReceived(8s000ms): 6.46 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 36.08 MB, 71.44 MB, 107.30 MB, 145.09 MB, 169.61 MB, 186.89 MB, 197.10 MB, 200.52 MB, 201.94 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.02 MB (211834065) - TotalGetBatchTime: 55s220ms - DataArrivalTimer: 54s772ms SenderSide: - DeserializeRowBatchTime: 4s248ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s466ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 245.684ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000092 (host=vc1540.foo.com:22000):(Total: 4m21s, non-child: 12s851ms, % non-child: 4.91%) MemoryUsage(8s000ms): 55.73 MB, 73.84 MB, 101.85 MB, 106.98 MB, 108.02 MB, 108.02 MB, 108.02 MB, 122.97 MB, 198.23 MB, 262.87 MB, 312.03 MB, 360.39 MB, 390.36 MB, 413.11 MB, 436.04 MB, 445.79 MB, 445.79 MB, 469.54 MB, 477.84 MB, 479.59 MB, 480.78 MB, 483.48 MB, 484.90 MB, 698.39 MB, 760.20 MB, 792.35 MB, 768.72 MB, 795.66 MB, 799.91 MB, 808.92 MB, 807.24 MB, 797.56 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.12 MB (3276800) - PeakMemoryUsage: 817.63 MB (857350858) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1108190946) - RowsProduced: 301.50K (301504) - TotalNetworkReceiveTime: 3m57s - TotalNetworkSendTime: 6s446ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.19K (1186) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 658.900ms - TotalThreadsUserTime: 7s576ms - TotalThreadsVoluntaryContextSwitches: 3.66K (3656) Fragment Instance Lifecycle Timings: - ExecTime: 1m14s - ExecTreeExecTime: 59s331ms - OpenTime: 3m7s - ExecTreeOpenTime: 3m6s - PrepareTime: 335.739ms - ExecTreePrepareTime: 2.299ms KrpcDataStreamSender (dst_id=23):(Total: 2s247ms, non-child: 2s247ms, % non-child: 100.00%) - BytesSent: 44.39 MB (46547038) - OverallThroughput: 19.75 MB/sec - PeakMemoryUsage: 70.59 MB (74020608) - RowsReturned: 301.50K (301504) - RpcRetry: 0 (0) - SerializeBatchTime: 2s074ms - UncompressedRowBatchSize: 82.05 MB (86035773) CodeGen:(Total: 966.679ms, non-child: 966.679ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 297.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 551.618ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 116.263ms HASH_JOIN_NODE (id=11):(Total: 4m5s, non-child: 771.095ms, % non-child: 0.31%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 607.848ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.50K (301504) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.759ms - RowsReturned: 301.50K (301504) - RowsReturnedRate: 1.23 K/sec Buffer pool: - AllocTime: 127.551ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 449.754ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 124.285ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 47.495ms, % non-child: 0.08%) - ConvertRowBatchTime: 11.892ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.66 K/sec RecvrSide: BytesReceived(1s000ms): 578.38 KB, 1.61 MB, 2.34 MB, 3.30 MB, 4.19 MB, 6.21 MB, 8.72 MB, 11.39 MB, 13.40 MB, 16.47 MB, 20.84 MB, 23.37 MB, 26.13 MB, 29.11 MB, 31.21 MB, 32.74 MB, 33.38 MB, 35.16 MB, 37.09 MB, 38.95 MB, 40.97 MB, 42.86 MB, 44.31 MB, 46.24 MB, 48.51 MB, 50.96 MB, 51.77 MB, 53.40 MB, 54.40 MB, 55.62 MB, 57.14 MB, 57.81 MB, 58.50 MB, 58.84 MB, 59.19 MB, 59.36 MB, 59.68 MB, 59.91 MB, 60.64 MB, 60.96 MB, 61.33 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.42 MB, 62.50 MB, 62.50 MB, 62.75 MB, 62.91 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 767.341ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m4s, non-child: 56.869ms, % non-child: 0.03%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 25.947ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.24K (306243) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.221ms - RowsReturned: 301.50K (301504) - RowsReturnedRate: 1.63 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 23.688ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.800ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 17.814us, non-child: 17.814us, % non-child: 100.00%) - ConvertRowBatchTime: 7.320us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.85 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.818us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 19.882us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m4s, non-child: 7s313ms, % non-child: 3.97%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7032121) - BuildTime: 5s474ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727360) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s338ms - RowsReturned: 306.24K (306243) - RowsReturnedRate: 1.66 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s719ms - BuildRowsPartitioned: 7.03M (7032121) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.01K (14007) - HashTablesBuildTime: 1s724ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m59s, non-child: 228.093ms, % non-child: 0.19%) - ConvertRowBatchTime: 177.474ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7032121) - RowsReturnedRate: 59.05 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 7.41 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 22.57 MB, 43.30 MB, 75.81 MB, 114.73 MB, 153.31 MB, 185.32 MB, 218.76 MB, 250.49 MB, 276.04 MB, 296.53 MB, 313.20 MB, 328.26 MB, 340.81 MB, 352.63 MB, 363.41 MB, 373.51 MB, 379.91 MB, 386.38 MB, 391.38 MB, 397.01 MB, 401.18 MB, 403.91 MB, 406.32 MB, 408.37 MB, 410.26 MB, 410.98 MB, 412.15 MB, 413.27 MB, 414.28 MB, 414.53 MB, 415.54 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.79 MB (435991502) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 1s873ms - NumBatchesAccepted: 635 (635) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s033ms, non-child: 629.640ms, % non-child: 1.08%) - ConvertRowBatchTime: 134.925ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727360) - RowsReturnedRate: 98.69 K/sec RecvrSide: BytesReceived(8s000ms): 6.82 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 33.17 MB, 72.48 MB, 110.90 MB, 144.38 MB, 169.94 MB, 186.04 MB, 196.69 MB, 200.21 MB, 201.68 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.10 MB (211912320) - TotalGetBatchTime: 57s895ms - DataArrivalTimer: 57s403ms SenderSide: - DeserializeRowBatchTime: 3s025ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 41 (41) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s773ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 24.982ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000094 (host=vc1517.foo.com:22000):(Total: 4m20s, non-child: 9s016ms, % non-child: 3.46%) MemoryUsage(8s000ms): 51.23 MB, 75.64 MB, 108.22 MB, 110.24 MB, 112.93 MB, 113.14 MB, 113.25 MB, 129.08 MB, 191.63 MB, 259.68 MB, 310.74 MB, 353.58 MB, 385.93 MB, 408.16 MB, 432.86 MB, 441.43 MB, 443.19 MB, 465.24 MB, 477.18 MB, 477.18 MB, 477.18 MB, 477.74 MB, 477.93 MB, 709.21 MB, 752.94 MB, 779.05 MB, 758.71 MB, 785.44 MB, 793.02 MB, 799.57 MB, 802.04 MB, 794.58 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.01 MB (3153920) - PeakMemoryUsage: 805.20 MB (844317354) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1094859102) - RowsProduced: 301.43K (301431) - TotalNetworkReceiveTime: 3m58s - TotalNetworkSendTime: 2s996ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.18K (1177) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 576.913ms - TotalThreadsUserTime: 7s365ms - TotalThreadsVoluntaryContextSwitches: 3.27K (3270) Fragment Instance Lifecycle Timings: - ExecTime: 1m14s - ExecTreeExecTime: 1m3s - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 968.524ms - ExecTreePrepareTime: 81.380ms KrpcDataStreamSender (dst_id=23):(Total: 2s923ms, non-child: 2s923ms, % non-child: 100.00%) - BytesSent: 44.36 MB (46517138) - OverallThroughput: 15.17 MB/sec - PeakMemoryUsage: 67.64 MB (70924032) - RowsReturned: 301.43K (301431) - RpcRetry: 0 (0) - SerializeBatchTime: 2s344ms - UncompressedRowBatchSize: 82.01 MB (85993044) CodeGen:(Total: 1s128ms, non-child: 1s128ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 278.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 131 (131) - NumInstructions: 7.29K (7285) - OptimizationTime: 632.580ms - PeakMemoryUsage: 3.56 MB (3729920) - PrepareTime: 203.186ms HASH_JOIN_NODE (id=11):(Total: 4m7s, non-child: 1s609ms, % non-child: 0.65%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s398ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.43K (301431) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.959ms - RowsReturned: 301.43K (301431) - RowsReturnedRate: 1.22 K/sec Buffer pool: - AllocTime: 77.683ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s336ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 60.770ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 58s525ms, non-child: 19.468ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.975ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.87 K/sec RecvrSide: BytesReceived(1s000ms): 496.31 KB, 1.45 MB, 2.50 MB, 3.54 MB, 4.19 MB, 6.37 MB, 8.64 MB, 11.39 MB, 13.16 MB, 16.23 MB, 20.68 MB, 23.04 MB, 25.24 MB, 29.27 MB, 31.45 MB, 33.30 MB, 34.84 MB, 35.56 MB, 37.41 MB, 39.03 MB, 41.08 MB, 42.70 MB, 43.99 MB, 45.92 MB, 48.16 MB, 49.26 MB, 50.15 MB, 51.65 MB, 53.58 MB, 55.70 MB, 57.12 MB, 57.73 MB, 58.44 MB, 58.76 MB, 59.09 MB, 59.30 MB, 59.68 MB, 59.91 MB, 60.48 MB, 60.64 MB, 61.01 MB, 61.30 MB, 61.62 MB, 61.78 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.42 MB, 62.50 MB, 62.50 MB, 62.50 MB, 62.67 MB, 62.67 MB, 62.91 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 58s511ms - DataArrivalTimer: 58s505ms SenderSide: - DeserializeRowBatchTime: 651.897ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m7s, non-child: 43.315ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 9.848ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.32K (306316) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.300ms - RowsReturned: 301.43K (301431) - RowsReturnedRate: 1.61 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.179ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 281.229us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 16.812us, non-child: 16.812us, % non-child: 100.00%) - ConvertRowBatchTime: 6.652us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.26 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.651us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 8.212us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m7s, non-child: 6s720ms, % non-child: 3.58%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.02M (7023125) - BuildTime: 5s002ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726696) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s349ms - RowsReturned: 306.32K (306316) - RowsReturnedRate: 1.63 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s213ms - BuildRowsPartitioned: 7.02M (7023125) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.95K (13947) - HashTablesBuildTime: 753.852ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 310.736ms, % non-child: 0.26%) - ConvertRowBatchTime: 174.140ms - PeakMemoryUsage: 0 - RowsReturned: 7.02M (7023125) - RowsReturnedRate: 59.07 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 6.99 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 21.65 MB, 38.83 MB, 77.33 MB, 114.64 MB, 151.96 MB, 187.51 MB, 219.85 MB, 250.90 MB, 272.39 MB, 295.41 MB, 313.39 MB, 325.88 MB, 340.36 MB, 353.35 MB, 362.69 MB, 372.75 MB, 378.93 MB, 385.70 MB, 390.40 MB, 396.57 MB, 401.19 MB, 403.64 MB, 405.80 MB, 407.76 MB, 409.66 MB, 410.62 MB, 411.86 MB, 413.01 MB, 413.69 MB, 414.02 MB, 414.99 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.26 MB (435433750) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 1s602ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 1m1s, non-child: 533.986ms, % non-child: 0.86%) - ConvertRowBatchTime: 135.184ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726696) - RowsReturnedRate: 92.56 K/sec RecvrSide: BytesReceived(8s000ms): 6.94 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 37.76 MB, 73.20 MB, 110.45 MB, 145.60 MB, 169.62 MB, 186.46 MB, 196.99 MB, 200.35 MB, 201.60 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.07 MB (211887752) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 2s069ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 953.937ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 9.067ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000090 (host=vc1513.foo.com:22000):(Total: 4m20s, non-child: 13s155ms, % non-child: 5.05%) MemoryUsage(8s000ms): 56.38 MB, 74.56 MB, 106.39 MB, 107.59 MB, 107.98 MB, 108.51 MB, 110.24 MB, 111.18 MB, 186.27 MB, 266.53 MB, 321.40 MB, 370.79 MB, 402.53 MB, 423.78 MB, 449.86 MB, 458.36 MB, 458.92 MB, 480.92 MB, 490.92 MB, 490.92 MB, 490.92 MB, 490.92 MB, 490.92 MB, 723.62 MB, 762.62 MB, 795.51 MB, 787.33 MB, 796.85 MB, 801.01 MB, 812.88 MB, 814.36 MB, 798.17 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 820.23 MB (860070442) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1114757875) - RowsProduced: 301.34K (301341) - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 5s083ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.23K (1229) - TotalThreadsTotalWallClockTime: 4m20s - TotalThreadsSysTime: 693.894ms - TotalThreadsUserTime: 7s557ms - TotalThreadsVoluntaryContextSwitches: 3.83K (3834) Fragment Instance Lifecycle Timings: - ExecTime: 1m14s - ExecTreeExecTime: 57s647ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 357.410ms - ExecTreePrepareTime: 16.900ms KrpcDataStreamSender (dst_id=23):(Total: 3s882ms, non-child: 3s882ms, % non-child: 100.00%) - BytesSent: 44.42 MB (46580646) - OverallThroughput: 11.44 MB/sec - PeakMemoryUsage: 70.69 MB (74118912) - RowsReturned: 301.34K (301341) - RpcRetry: 0 (0) - SerializeBatchTime: 3s760ms - UncompressedRowBatchSize: 82.09 MB (86076698) CodeGen:(Total: 1s095ms, non-child: 1s095ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 284.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 646.914ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 159.559ms HASH_JOIN_NODE (id=11):(Total: 4m2s, non-child: 1s535ms, % non-child: 0.63%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s044ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.34K (301341) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 124.682ms - RowsReturned: 301.34K (301341) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 389.861ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 806.111ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 237.833ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 122.440ms, % non-child: 0.19%) - ConvertRowBatchTime: 11.942ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.35 K/sec RecvrSide: BytesReceived(2s000ms): 1.17 MB, 2.90 MB, 5.32 MB, 9.97 MB, 14.98 MB, 22.12 MB, 27.70 MB, 32.22 MB, 34.72 MB, 37.90 MB, 41.67 MB, 44.91 MB, 49.37 MB, 52.42 MB, 55.09 MB, 57.39 MB, 58.44 MB, 59.19 MB, 59.88 MB, 60.90 MB, 61.34 MB, 61.62 MB, 61.78 MB, 62.10 MB, 62.38 MB, 62.63 MB, 62.83 MB, 62.99 MB, 63.03 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 1s094ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m57s, non-child: 84.456ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 36.974ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.20K (306201) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.533ms - RowsReturned: 301.34K (301341) - RowsReturnedRate: 1.70 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 32.342ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 372.907us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 31.121us, non-child: 31.121us, % non-child: 100.00%) - ConvertRowBatchTime: 22.047us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 3.92 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.563us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.158us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m57s, non-child: 7s269ms, % non-child: 4.09%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026559) - BuildTime: 5s570ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726100) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s320ms - RowsReturned: 306.20K (306201) - RowsReturnedRate: 1.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s630ms - BuildRowsPartitioned: 7.03M (7026559) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.91K (13913) - HashTablesBuildTime: 917.680ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 283.879ms, % non-child: 0.25%) - ConvertRowBatchTime: 174.519ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026559) - RowsReturnedRate: 61.62 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 7.41 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 29.48 MB, 77.58 MB, 115.57 MB, 154.07 MB, 189.53 MB, 220.61 MB, 251.84 MB, 275.45 MB, 295.80 MB, 312.81 MB, 329.03 MB, 341.17 MB, 353.47 MB, 363.64 MB, 373.78 MB, 379.47 MB, 385.49 MB, 391.06 MB, 396.33 MB, 401.23 MB, 403.83 MB, 406.16 MB, 408.17 MB, 409.88 MB, 410.70 MB, 412.23 MB, 413.19 MB, 413.95 MB, 414.32 MB, 415.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.47 MB (435646658) - TotalGetBatchTime: 1m53s - DataArrivalTimer: 1m53s SenderSide: - DeserializeRowBatchTime: 2s555ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 41 (41) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 56s368ms, non-child: 455.494ms, % non-child: 0.81%) - ConvertRowBatchTime: 131.936ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726100) - RowsReturnedRate: 101.58 K/sec RecvrSide: BytesReceived(8s000ms): 7.30 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 39.31 MB, 72.88 MB, 111.38 MB, 145.79 MB, 170.62 MB, 187.27 MB, 197.00 MB, 200.37 MB, 201.70 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.05 MB (211865700) - TotalGetBatchTime: 56s233ms - DataArrivalTimer: 55s913ms SenderSide: - DeserializeRowBatchTime: 2s669ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 51 (51) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s490ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 32.225ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000085 (host=vc1525.foo.com:22000):(Total: 4m19s, non-child: 14s634ms, % non-child: 5.64%) MemoryUsage(8s000ms): 52.54 MB, 72.71 MB, 104.60 MB, 106.88 MB, 107.54 MB, 108.14 MB, 108.14 MB, 108.52 MB, 178.47 MB, 256.86 MB, 308.11 MB, 352.79 MB, 382.79 MB, 403.31 MB, 428.29 MB, 436.67 MB, 437.61 MB, 458.29 MB, 469.67 MB, 469.67 MB, 469.67 MB, 469.67 MB, 475.36 MB, 720.10 MB, 755.93 MB, 783.70 MB, 765.11 MB, 788.66 MB, 792.70 MB, 800.37 MB, 802.79 MB, 780.85 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 808.70 MB (847978930) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1113875054) - RowsProduced: 301.49K (301487) - TotalNetworkReceiveTime: 3m52s - TotalNetworkSendTime: 7s299ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.21K (1214) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 647.902ms - TotalThreadsUserTime: 7s436ms - TotalThreadsVoluntaryContextSwitches: 3.68K (3684) Fragment Instance Lifecycle Timings: - ExecTime: 1m13s - ExecTreeExecTime: 56s847ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 400.313ms - ExecTreePrepareTime: 10.434ms KrpcDataStreamSender (dst_id=23):(Total: 2s362ms, non-child: 2s362ms, % non-child: 100.00%) - BytesSent: 44.39 MB (46544958) - OverallThroughput: 18.79 MB/sec - PeakMemoryUsage: 70.69 MB (74118912) - RowsReturned: 301.49K (301487) - RpcRetry: 0 (0) - SerializeBatchTime: 2s238ms - UncompressedRowBatchSize: 82.05 MB (86032125) CodeGen:(Total: 1s255ms, non-child: 1s255ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 457.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 587.645ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 192.667ms HASH_JOIN_NODE (id=11):(Total: 4m1s, non-child: 1s028ms, % non-child: 0.43%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 639.704ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.49K (301487) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 119.128ms - RowsReturned: 301.49K (301487) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 314.198ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 446.355ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 192.666ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m3s, non-child: 71.107ms, % non-child: 0.11%) - ConvertRowBatchTime: 11.794ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.30 K/sec RecvrSide: BytesReceived(2s000ms): 1.01 MB, 2.86 MB, 4.80 MB, 9.73 MB, 14.62 MB, 21.86 MB, 27.46 MB, 32.01 MB, 34.52 MB, 37.01 MB, 41.59 MB, 45.11 MB, 49.31 MB, 52.20 MB, 54.89 MB, 57.36 MB, 58.57 MB, 59.11 MB, 59.64 MB, 60.64 MB, 61.31 MB, 61.66 MB, 61.86 MB, 62.10 MB, 62.34 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m3s - DataArrivalTimer: 1m3s SenderSide: - DeserializeRowBatchTime: 1s090ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m56s, non-child: 82.562ms, % non-child: 0.05%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 52.622ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.40K (306403) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.966ms - RowsReturned: 301.49K (301487) - RowsReturnedRate: 1.71 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 51.955ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 364.304us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 24.864us, non-child: 24.864us, % non-child: 100.00%) - ConvertRowBatchTime: 5.226us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 4.91 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.692us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 7.768us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m56s, non-child: 7s049ms, % non-child: 4.00%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.02M (7020237) - BuildTime: 5s306ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s366ms - RowsReturned: 306.40K (306403) - RowsReturnedRate: 1.74 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s188ms - BuildRowsPartitioned: 7.02M (7020237) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.07K (14072) - HashTablesBuildTime: 1s075ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m53s, non-child: 285.887ms, % non-child: 0.25%) - ConvertRowBatchTime: 175.763ms - PeakMemoryUsage: 0 - RowsReturned: 7.02M (7020237) - RowsReturnedRate: 61.75 K/sec RecvrSide: BytesReceived(4s000ms): 948.82 KB, 6.65 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 27.63 MB, 75.98 MB, 114.56 MB, 152.04 MB, 184.31 MB, 218.08 MB, 250.37 MB, 275.45 MB, 296.24 MB, 312.30 MB, 326.96 MB, 340.78 MB, 353.59 MB, 362.72 MB, 372.58 MB, 380.79 MB, 385.58 MB, 391.05 MB, 396.47 MB, 401.52 MB, 403.85 MB, 406.12 MB, 408.03 MB, 409.34 MB, 410.35 MB, 411.96 MB, 412.70 MB, 413.62 MB, 414.28 MB, 414.89 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.09 MB (435254694) - TotalGetBatchTime: 1m53s - DataArrivalTimer: 1m53s SenderSide: - DeserializeRowBatchTime: 2s368ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 45 (45) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 55s641ms, non-child: 515.197ms, % non-child: 0.93%) - ConvertRowBatchTime: 135.530ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726763) - RowsReturnedRate: 102.92 K/sec RecvrSide: BytesReceived(8s000ms): 7.02 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.79 MB, 72.64 MB, 110.74 MB, 145.33 MB, 170.56 MB, 187.17 MB, 197.42 MB, 200.59 MB, 202.02 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.07 MB (211890231) - TotalGetBatchTime: 55s503ms - DataArrivalTimer: 55s126ms SenderSide: - DeserializeRowBatchTime: 2s669ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 974.998ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 51.801ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000083 (host=vc1539.foo.com:22000):(Total: 4m18s, non-child: 15s651ms, % non-child: 6.06%) MemoryUsage(8s000ms): 55.90 MB, 79.39 MB, 107.12 MB, 108.73 MB, 110.84 MB, 111.92 MB, 112.06 MB, 133.49 MB, 208.62 MB, 269.23 MB, 321.84 MB, 364.12 MB, 396.61 MB, 414.71 MB, 456.01 MB, 461.06 MB, 463.93 MB, 494.06 MB, 497.56 MB, 497.56 MB, 497.56 MB, 497.56 MB, 535.38 MB, 732.39 MB, 769.98 MB, 797.71 MB, 786.15 MB, 810.17 MB, 822.46 MB, 832.34 MB, 832.91 MB, 796.57 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 839.06 MB (879813522) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.06 GB (1141810721) - RowsProduced: 302.16K (302161) - TotalNetworkReceiveTime: 3m47s - TotalNetworkSendTime: 8s215ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.17K (1166) - TotalThreadsTotalWallClockTime: 4m17s - TotalThreadsSysTime: 691.895ms - TotalThreadsUserTime: 7s468ms - TotalThreadsVoluntaryContextSwitches: 3.75K (3750) Fragment Instance Lifecycle Timings: - ExecTime: 1m13s - ExecTreeExecTime: 54s851ms - OpenTime: 3m3s - ExecTreeOpenTime: 3m2s - PrepareTime: 1s228ms - ExecTreePrepareTime: 374.718ms KrpcDataStreamSender (dst_id=23):(Total: 3s740ms, non-child: 3s740ms, % non-child: 100.00%) - BytesSent: 44.50 MB (46666596) - OverallThroughput: 11.90 MB/sec - PeakMemoryUsage: 70.72 MB (74151680) - RowsReturned: 302.16K (302161) - RpcRetry: 0 (0) - SerializeBatchTime: 3s117ms - UncompressedRowBatchSize: 82.26 MB (86253958) CodeGen:(Total: 1s062ms, non-child: 1s062ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 283.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 595.398ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 168.571ms HASH_JOIN_NODE (id=11):(Total: 3m57s, non-child: 1s679ms, % non-child: 0.71%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s064ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.16K (302161) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.049ms - RowsReturned: 302.16K (302161) - RowsReturnedRate: 1.27 K/sec Buffer pool: - AllocTime: 234.839ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 918.914ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 145.222ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 57s823ms, non-child: 15.554ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.334ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.95 K/sec RecvrSide: BytesReceived(1s000ms): 1.21 MB, 2.50 MB, 3.22 MB, 3.95 MB, 6.05 MB, 8.64 MB, 11.63 MB, 13.01 MB, 16.55 MB, 20.76 MB, 23.34 MB, 26.21 MB, 28.79 MB, 30.72 MB, 33.07 MB, 34.68 MB, 35.48 MB, 36.85 MB, 38.79 MB, 40.97 MB, 42.70 MB, 43.99 MB, 46.01 MB, 48.72 MB, 50.80 MB, 51.85 MB, 53.19 MB, 54.40 MB, 56.10 MB, 57.25 MB, 57.83 MB, 58.44 MB, 58.60 MB, 59.09 MB, 59.30 MB, 59.68 MB, 60.00 MB, 60.64 MB, 60.96 MB, 61.28 MB, 61.38 MB, 61.46 MB, 61.78 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.75 MB, 62.99 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 57s810ms - DataArrivalTimer: 57s807ms SenderSide: - DeserializeRowBatchTime: 2s030ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 5 (5) - NumEarlySenders: 5 (5) HASH_JOIN_NODE (id=10):(Total: 2m58s, non-child: 348.848ms, % non-child: 0.20%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 119.729ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.93K (306925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.870ms - RowsReturned: 302.16K (302161) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 119.057ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 284.287us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 15.662us, non-child: 15.662us, % non-child: 100.00%) - ConvertRowBatchTime: 4.992us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.79 M/sec RecvrSide: BytesReceived(1s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 5.262us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 16.315us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m58s, non-child: 7s696ms, % non-child: 4.32%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7028658) - BuildTime: 5s808ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727699) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s332ms - RowsReturned: 306.93K (306925) - RowsReturnedRate: 1.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s612ms - BuildRowsPartitioned: 7.03M (7028658) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.03K (14028) - HashTablesBuildTime: 1s147ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 323.886ms, % non-child: 0.28%) - ConvertRowBatchTime: 175.355ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7028658) - RowsReturnedRate: 60.10 K/sec RecvrSide: BytesReceived(4s000ms): 2.61 MB, 8.68 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 28.39 MB, 47.51 MB, 84.99 MB, 126.27 MB, 162.15 MB, 196.60 MB, 228.78 MB, 259.29 MB, 281.20 MB, 300.30 MB, 318.61 MB, 331.91 MB, 344.41 MB, 357.36 MB, 367.74 MB, 375.53 MB, 382.87 MB, 387.80 MB, 393.08 MB, 398.65 MB, 402.83 MB, 405.31 MB, 407.65 MB, 408.85 MB, 410.57 MB, 411.16 MB, 412.66 MB, 413.76 MB, 414.09 MB, 414.99 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.59 MB (435776796) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 2s617ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 53s496ms, non-child: 365.076ms, % non-child: 0.68%) - ConvertRowBatchTime: 130.469ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727699) - RowsReturnedRate: 107.07 K/sec RecvrSide: BytesReceived(8s000ms): 8.21 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 10.37 MB, 44.21 MB, 77.35 MB, 115.48 MB, 149.89 MB, 171.83 MB, 189.98 MB, 198.02 MB, 201.00 MB, 202.11 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.11 MB (211924863) - TotalGetBatchTime: 53s363ms - DataArrivalTimer: 53s131ms SenderSide: - DeserializeRowBatchTime: 2s998ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 32 (32) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s131ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 118.919ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008b (host=vc1520.foo.com:22000):(Total: 4m17s, non-child: 11s324ms, % non-child: 4.40%) MemoryUsage(8s000ms): 56.19 MB, 76.60 MB, 107.09 MB, 109.01 MB, 110.45 MB, 110.66 MB, 110.66 MB, 110.66 MB, 190.86 MB, 264.54 MB, 314.86 MB, 361.79 MB, 391.53 MB, 414.92 MB, 432.17 MB, 448.54 MB, 449.54 MB, 473.92 MB, 482.54 MB, 482.54 MB, 482.54 MB, 482.54 MB, 482.54 MB, 720.36 MB, 754.69 MB, 787.28 MB, 772.71 MB, 785.66 MB, 788.76 MB, 800.80 MB, 804.53 MB, 776.46 MB ThreadUsage(8s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 814.54 MB (854106522) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1091729849) - RowsProduced: 301.54K (301539) - TotalNetworkReceiveTime: 3m53s - TotalNetworkSendTime: 5s550ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.16K (1156) - TotalThreadsTotalWallClockTime: 4m16s - TotalThreadsSysTime: 597.909ms - TotalThreadsUserTime: 7s495ms - TotalThreadsVoluntaryContextSwitches: 3.49K (3493) Fragment Instance Lifecycle Timings: - ExecTime: 1m11s - ExecTreeExecTime: 57s248ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 270.335ms - ExecTreePrepareTime: 20.087ms KrpcDataStreamSender (dst_id=23):(Total: 2s946ms, non-child: 2s946ms, % non-child: 100.00%) - BytesSent: 44.40 MB (46558457) - OverallThroughput: 15.07 MB/sec - PeakMemoryUsage: 73.62 MB (77199104) - RowsReturned: 301.54K (301539) - RpcRetry: 0 (0) - SerializeBatchTime: 2s812ms - UncompressedRowBatchSize: 82.05 MB (86040125) CodeGen:(Total: 1s011ms, non-child: 1s011ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 339.788ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 575.675ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 85.877ms HASH_JOIN_NODE (id=11):(Total: 4m1s, non-child: 784.036ms, % non-child: 0.32%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 591.229ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.54K (301539) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.131ms - RowsReturned: 301.54K (301539) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 65.674ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 510.692ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.980ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m2s, non-child: 34.203ms, % non-child: 0.05%) - ConvertRowBatchTime: 11.380ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.39 K/sec RecvrSide: BytesReceived(2s000ms): 1.01 MB, 2.82 MB, 5.12 MB, 9.65 MB, 14.70 MB, 21.82 MB, 27.62 MB, 32.58 MB, 34.92 MB, 37.98 MB, 41.64 MB, 45.07 MB, 49.43 MB, 52.18 MB, 54.93 MB, 57.26 MB, 58.00 MB, 59.23 MB, 59.80 MB, 60.64 MB, 61.31 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.34 MB, 62.59 MB, 62.83 MB, 63.03 MB, 63.23 MB, 63.31 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m2s - DataArrivalTimer: 1m2s SenderSide: - DeserializeRowBatchTime: 1s179ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m58s, non-child: 61.515ms, % non-child: 0.03%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 17.077ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.20K (306204) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.414ms - RowsReturned: 301.54K (301539) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 14.475ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.156ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 18.189us, non-child: 18.189us, % non-child: 100.00%) - ConvertRowBatchTime: 7.140us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.71 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 5.292us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.010us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m58s, non-child: 7s653ms, % non-child: 4.29%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7030167) - BuildTime: 6s085ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5730182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s357ms - RowsReturned: 306.20K (306204) - RowsReturnedRate: 1.72 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 5s143ms - BuildRowsPartitioned: 7.03M (7030167) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.13K (14129) - HashTablesBuildTime: 922.385ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 354.187ms, % non-child: 0.31%) - ConvertRowBatchTime: 173.620ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7030167) - RowsReturnedRate: 61.30 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.08 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 39.67 MB, 77.07 MB, 112.79 MB, 154.49 MB, 189.53 MB, 219.01 MB, 250.51 MB, 276.36 MB, 295.53 MB, 313.73 MB, 328.05 MB, 341.21 MB, 350.59 MB, 363.66 MB, 373.75 MB, 379.37 MB, 386.12 MB, 391.50 MB, 397.01 MB, 401.37 MB, 404.14 MB, 406.72 MB, 408.34 MB, 410.04 MB, 410.94 MB, 412.47 MB, 413.36 MB, 414.12 MB, 414.61 MB, 415.44 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.68 MB (435870354) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 2s021ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 55s855ms, non-child: 364.877ms, % non-child: 0.65%) - ConvertRowBatchTime: 135.701ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5730182) - RowsReturnedRate: 102.59 K/sec RecvrSide: BytesReceived(8s000ms): 7.06 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 38.79 MB, 72.16 MB, 110.96 MB, 145.79 MB, 170.14 MB, 187.76 MB, 197.07 MB, 200.41 MB, 202.11 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.19 MB (212016734) - TotalGetBatchTime: 55s717ms - DataArrivalTimer: 55s491ms SenderSide: - DeserializeRowBatchTime: 2s135ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s371ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 16.100ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000087 (host=vc1527.foo.com:22000):(Total: 4m16s, non-child: 11s754ms, % non-child: 4.58%) MemoryUsage(4s000ms): 37.07 MB, 70.15 MB, 74.28 MB, 74.84 MB, 98.33 MB, 107.76 MB, 108.13 MB, 108.51 MB, 109.15 MB, 109.68 MB, 110.41 MB, 110.41 MB, 110.41 MB, 110.41 MB, 110.41 MB, 143.35 MB, 180.67 MB, 207.14 MB, 246.20 MB, 278.17 MB, 306.42 MB, 326.82 MB, 344.17 MB, 376.17 MB, 376.17 MB, 402.92 MB, 408.17 MB, 408.29 MB, 427.17 MB, 441.51 MB, 443.79 MB, 444.20 MB, 444.67 MB, 444.67 MB, 466.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 476.67 MB, 504.67 MB, 716.40 MB, 738.80 MB, 751.74 MB, 769.20 MB, 783.88 MB, 792.26 MB, 779.41 MB, 773.66 MB, 789.07 MB, 792.01 MB, 792.01 MB, 793.13 MB, 799.79 MB, 807.72 MB, 798.21 MB, 795.24 MB, 784.18 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 815.09 MB (854680010) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1093049150) - RowsProduced: 300.95K (300952) - TotalNetworkReceiveTime: 3m50s - TotalNetworkSendTime: 4s354ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.14K (1139) - TotalThreadsTotalWallClockTime: 4m16s - TotalThreadsSysTime: 684.896ms - TotalThreadsUserTime: 7s574ms - TotalThreadsVoluntaryContextSwitches: 3.71K (3705) Fragment Instance Lifecycle Timings: - ExecTime: 1m11s - ExecTreeExecTime: 57s029ms - OpenTime: 3m4s - ExecTreeOpenTime: 3m3s - PrepareTime: 467.745ms - ExecTreePrepareTime: 53.636ms KrpcDataStreamSender (dst_id=23):(Total: 2s926ms, non-child: 2s926ms, % non-child: 100.00%) - BytesSent: 44.34 MB (46494405) - OverallThroughput: 15.15 MB/sec - PeakMemoryUsage: 70.67 MB (74102528) - RowsReturned: 300.95K (300952) - RpcRetry: 0 (0) - SerializeBatchTime: 2s732ms - UncompressedRowBatchSize: 81.94 MB (85915210) CodeGen:(Total: 1s136ms, non-child: 1s136ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 364.150ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 580.372ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 183.460ms HASH_JOIN_NODE (id=11):(Total: 4m1s, non-child: 1s969ms, % non-child: 0.82%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s805ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.95K (300952) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.138ms - RowsReturned: 300.95K (300952) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 1s354ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s681ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 122.932ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 58s579ms, non-child: 38.994ms, % non-child: 0.07%) - ConvertRowBatchTime: 11.688ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.86 K/sec RecvrSide: BytesReceived(1s000ms): 744.01 KB, 1.70 MB, 1.78 MB, 3.14 MB, 4.36 MB, 6.78 MB, 8.96 MB, 11.63 MB, 13.32 MB, 16.95 MB, 21.00 MB, 23.42 MB, 26.54 MB, 29.35 MB, 31.77 MB, 33.47 MB, 33.96 MB, 34.68 MB, 36.37 MB, 38.63 MB, 41.08 MB, 42.94 MB, 43.99 MB, 46.09 MB, 48.88 MB, 50.72 MB, 52.01 MB, 53.48 MB, 54.80 MB, 55.95 MB, 57.06 MB, 57.99 MB, 58.60 MB, 58.90 MB, 59.27 MB, 59.36 MB, 59.68 MB, 60.00 MB, 60.64 MB, 61.04 MB, 61.33 MB, 61.62 MB, 61.78 MB, 61.86 MB, 62.02 MB, 62.10 MB, 62.18 MB, 62.34 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.83 MB, 62.99 MB, 62.99 MB, 63.15 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 58s566ms - DataArrivalTimer: 58s540ms SenderSide: - DeserializeRowBatchTime: 942.846ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m, non-child: 72.280ms, % non-child: 0.04%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 11.444ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.83K (305826) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.207ms - RowsReturned: 300.95K (300952) - RowsReturnedRate: 1.67 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 10.774ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 325.049us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 15.415us, non-child: 15.415us, % non-child: 100.00%) - ConvertRowBatchTime: 5.372us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.91 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.487us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 9.141us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m, non-child: 7s982ms, % non-child: 4.42%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7031307) - BuildTime: 6s376ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727323) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s351ms - RowsReturned: 305.83K (305826) - RowsReturnedRate: 1.69 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 5s492ms - BuildRowsPartitioned: 7.03M (7031307) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.06K (14065) - HashTablesBuildTime: 835.069ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 298.091ms, % non-child: 0.26%) - ConvertRowBatchTime: 175.935ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7031307) - RowsReturnedRate: 60.23 K/sec RecvrSide: BytesReceived(4s000ms): 690.05 KB, 7.41 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 21.90 MB, 41.61 MB, 77.16 MB, 114.39 MB, 154.40 MB, 190.54 MB, 220.19 MB, 250.82 MB, 277.20 MB, 297.86 MB, 314.28 MB, 328.18 MB, 341.65 MB, 354.57 MB, 364.79 MB, 375.44 MB, 381.73 MB, 387.37 MB, 392.81 MB, 398.08 MB, 402.56 MB, 404.78 MB, 407.14 MB, 408.68 MB, 410.22 MB, 410.98 MB, 412.74 MB, 413.56 MB, 414.23 MB, 415.00 MB, 415.56 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.75 MB (435941034) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 1s892ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 55s716ms, non-child: 421.234ms, % non-child: 0.76%) - ConvertRowBatchTime: 135.849ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727323) - RowsReturnedRate: 102.79 K/sec RecvrSide: BytesReceived(4s000ms): 3.51 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 34.13 MB, 51.75 MB, 64.59 MB, 83.96 MB, 102.89 MB, 121.04 MB, 138.85 MB, 156.01 MB, 166.66 MB, 176.96 MB, 186.01 MB, 191.80 MB, 196.49 MB, 199.29 MB, 200.50 MB, 201.23 MB, 202.02 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.09 MB (211910951) - TotalGetBatchTime: 55s577ms - DataArrivalTimer: 55s295ms SenderSide: - DeserializeRowBatchTime: 2s556ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s950ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 10.663ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000081 (host=vc1532.foo.com:22000):(Total: 4m16s, non-child: 9s916ms, % non-child: 3.87%) MemoryUsage(4s000ms): 29.06 MB, 70.78 MB, 74.61 MB, 77.14 MB, 108.49 MB, 108.61 MB, 109.41 MB, 111.14 MB, 111.64 MB, 111.64 MB, 111.64 MB, 111.64 MB, 111.64 MB, 111.64 MB, 111.64 MB, 111.64 MB, 174.16 MB, 214.14 MB, 243.36 MB, 281.54 MB, 306.29 MB, 330.92 MB, 348.29 MB, 382.42 MB, 382.95 MB, 408.42 MB, 415.42 MB, 415.42 MB, 431.42 MB, 447.67 MB, 448.42 MB, 448.42 MB, 448.42 MB, 448.42 MB, 464.17 MB, 480.42 MB, 480.42 MB, 480.42 MB, 480.42 MB, 480.98 MB, 481.17 MB, 481.17 MB, 481.17 MB, 481.17 MB, 481.42 MB, 527.86 MB, 720.61 MB, 741.39 MB, 754.35 MB, 772.07 MB, 786.51 MB, 796.06 MB, 765.57 MB, 775.57 MB, 789.51 MB, 793.28 MB, 793.66 MB, 795.13 MB, 803.59 MB, 805.53 MB, 804.01 MB, 796.54 MB, 788.96 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 818.31 MB (858063282) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1111216392) - RowsProduced: 301.59K (301587) - TotalNetworkReceiveTime: 3m54s - TotalNetworkSendTime: 5s671ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.14K (1142) - TotalThreadsTotalWallClockTime: 4m14s - TotalThreadsSysTime: 700.893ms - TotalThreadsUserTime: 7s328ms - TotalThreadsVoluntaryContextSwitches: 3.34K (3341) Fragment Instance Lifecycle Timings: - ExecTime: 1m11s - ExecTreeExecTime: 1m - OpenTime: 3m3s - ExecTreeOpenTime: 3m2s - PrepareTime: 1s642ms - ExecTreePrepareTime: 94.960ms KrpcDataStreamSender (dst_id=23):(Total: 2s978ms, non-child: 2s978ms, % non-child: 100.00%) - BytesSent: 44.44 MB (46600472) - OverallThroughput: 14.92 MB/sec - PeakMemoryUsage: 70.61 MB (74036992) - RowsReturned: 301.59K (301587) - RpcRetry: 0 (0) - SerializeBatchTime: 1s614ms - UncompressedRowBatchSize: 82.14 MB (86130876) CodeGen:(Total: 783.071ms, non-child: 783.071ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 212.121ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 431.991ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 132.210ms HASH_JOIN_NODE (id=11):(Total: 4m2s, non-child: 1s052ms, % non-child: 0.43%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 811.144ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.59K (301587) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.552ms - RowsReturned: 301.59K (301587) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 111.978ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 709.765ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 100.714ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m1s, non-child: 15.959ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.819ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.52 K/sec RecvrSide: BytesReceived(2s000ms): 702.46 KB, 2.82 MB, 5.28 MB, 9.93 MB, 14.62 MB, 22.09 MB, 27.42 MB, 32.42 MB, 34.95 MB, 38.02 MB, 41.93 MB, 44.96 MB, 49.04 MB, 52.38 MB, 55.13 MB, 57.35 MB, 58.40 MB, 59.07 MB, 59.72 MB, 60.76 MB, 61.34 MB, 61.66 MB, 61.90 MB, 62.10 MB, 62.38 MB, 62.59 MB, 62.83 MB, 62.99 MB, 63.11 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 864.960ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 3m, non-child: 119.075ms, % non-child: 0.07%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 60.891ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.44K (306435) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.094ms - RowsReturned: 301.59K (301587) - RowsReturnedRate: 1.67 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 29.925ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 30.668ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 17.854us, non-child: 17.854us, % non-child: 100.00%) - ConvertRowBatchTime: 7.614us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.83 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.501us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 6.066us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m, non-child: 6s936ms, % non-child: 3.85%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7027244) - BuildTime: 5s278ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5729462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s338ms - RowsReturned: 306.44K (306435) - RowsReturnedRate: 1.70 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s374ms - BuildRowsPartitioned: 7.03M (7027244) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.21K (14212) - HashTablesBuildTime: 864.766ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 327.738ms, % non-child: 0.29%) - ConvertRowBatchTime: 176.963ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7027244) - RowsReturnedRate: 61.45 K/sec RecvrSide: BytesReceived(4s000ms): 1.01 MB, 7.67 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 37.91 MB, 78.68 MB, 113.89 MB, 153.05 MB, 189.19 MB, 219.85 MB, 250.21 MB, 277.76 MB, 298.39 MB, 313.89 MB, 328.84 MB, 342.10 MB, 354.39 MB, 366.22 MB, 375.23 MB, 381.34 MB, 387.32 MB, 391.90 MB, 397.54 MB, 402.19 MB, 404.77 MB, 407.18 MB, 408.67 MB, 410.37 MB, 410.79 MB, 412.39 MB, 413.39 MB, 414.05 MB, 414.66 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.51 MB (435689128) - TotalGetBatchTime: 1m54s - DataArrivalTimer: 1m54s SenderSide: - DeserializeRowBatchTime: 1s462ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 42 (42) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s784ms, non-child: 381.207ms, % non-child: 0.65%) - ConvertRowBatchTime: 134.119ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5729462) - RowsReturnedRate: 97.47 K/sec RecvrSide: BytesReceived(4s000ms): 4.70 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 35.24 MB, 51.99 MB, 64.03 MB, 83.49 MB, 102.35 MB, 123.19 MB, 139.71 MB, 156.18 MB, 166.21 MB, 176.89 MB, 185.65 MB, 191.53 MB, 196.10 MB, 199.46 MB, 200.86 MB, 201.47 MB, 202.09 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.17 MB (211990094) - TotalGetBatchTime: 58s647ms - DataArrivalTimer: 58s403ms SenderSide: - DeserializeRowBatchTime: 2s316ms - NumBatchesAccepted: 340 (340) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s506ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 60.106ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000089 (host=vc1523.foo.com:22000):(Total: 4m16s, non-child: 14s459ms, % non-child: 5.64%) MemoryUsage(4s000ms): 32.43 MB, 74.81 MB, 77.36 MB, 85.96 MB, 109.13 MB, 109.63 MB, 109.63 MB, 109.63 MB, 109.88 MB, 110.13 MB, 110.13 MB, 110.20 MB, 110.63 MB, 110.63 MB, 110.86 MB, 137.37 MB, 195.32 MB, 224.48 MB, 258.67 MB, 279.29 MB, 308.17 MB, 334.29 MB, 354.67 MB, 377.42 MB, 381.67 MB, 409.42 MB, 409.42 MB, 409.44 MB, 437.76 MB, 442.32 MB, 442.32 MB, 442.32 MB, 442.32 MB, 442.32 MB, 474.01 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 478.07 MB, 566.95 MB, 725.00 MB, 742.49 MB, 754.32 MB, 771.82 MB, 782.76 MB, 791.06 MB, 761.69 MB, 778.73 MB, 794.45 MB, 795.57 MB, 796.76 MB, 798.45 MB, 807.24 MB, 809.04 MB, 811.06 MB, 805.02 MB, 781.42 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 815.76 MB (855384450) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1117638012) - RowsProduced: 299.81K (299815) - TotalNetworkReceiveTime: 3m46s - TotalNetworkSendTime: 4s688ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.21K (1207) - TotalThreadsTotalWallClockTime: 4m14s - TotalThreadsSysTime: 697.894ms - TotalThreadsUserTime: 7s643ms - TotalThreadsVoluntaryContextSwitches: 3.99K (3992) Fragment Instance Lifecycle Timings: - ExecTime: 1m11s - ExecTreeExecTime: 54s149ms - OpenTime: 3m2s - ExecTreeOpenTime: 3m1s - PrepareTime: 1s698ms - ExecTreePrepareTime: 103.456ms KrpcDataStreamSender (dst_id=23):(Total: 4s299ms, non-child: 4s299ms, % non-child: 100.00%) - BytesSent: 44.15 MB (46299466) - OverallThroughput: 10.27 MB/sec - PeakMemoryUsage: 73.59 MB (77166336) - RowsReturned: 299.81K (299815) - RpcRetry: 0 (0) - SerializeBatchTime: 3s241ms - UncompressedRowBatchSize: 81.61 MB (85578554) CodeGen:(Total: 1s647ms, non-child: 1s647ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 368.632ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 834.897ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 402.469ms HASH_JOIN_NODE (id=11):(Total: 3m56s, non-child: 1s183ms, % non-child: 0.50%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 970.196ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 299.81K (299815) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.127ms - RowsReturned: 299.81K (299815) - RowsReturnedRate: 1.27 K/sec Buffer pool: - AllocTime: 200.696ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 850.792ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 118.648ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 58s446ms, non-child: 30.333ms, % non-child: 0.05%) - ConvertRowBatchTime: 11.634ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.88 K/sec RecvrSide: BytesReceived(1s000ms): 741.83 KB, 2.34 MB, 3.55 MB, 5.16 MB, 7.18 MB, 10.09 MB, 12.60 MB, 14.53 MB, 18.81 MB, 21.81 MB, 24.52 MB, 27.42 MB, 29.59 MB, 31.29 MB, 33.14 MB, 34.43 MB, 36.29 MB, 37.98 MB, 39.73 MB, 41.88 MB, 43.67 MB, 45.19 MB, 47.21 MB, 49.74 MB, 50.88 MB, 52.25 MB, 53.58 MB, 54.16 MB, 55.70 MB, 56.93 MB, 58.04 MB, 58.44 MB, 58.84 MB, 59.17 MB, 59.52 MB, 59.76 MB, 60.16 MB, 60.64 MB, 61.04 MB, 61.21 MB, 61.46 MB, 61.54 MB, 61.62 MB, 61.70 MB, 61.86 MB, 61.94 MB, 62.02 MB, 62.26 MB, 62.50 MB, 62.59 MB, 62.75 MB, 62.83 MB, 62.91 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 58s432ms - DataArrivalTimer: 58s415ms SenderSide: - DeserializeRowBatchTime: 1s255ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 4 (4) - NumEarlySenders: 4 (4) HASH_JOIN_NODE (id=10):(Total: 2m56s, non-child: 160.595ms, % non-child: 0.09%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 39.541ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 304.51K (304507) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.267ms - RowsReturned: 299.81K (299815) - RowsReturnedRate: 1.70 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 38.867ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 325.272us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 15.159us, non-child: 15.159us, % non-child: 100.00%) - ConvertRowBatchTime: 6.331us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.05 M/sec RecvrSide: BytesReceived(1s000ms): 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.856us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 16.521us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=9):(Total: 2m56s, non-child: 7s645ms, % non-child: 4.34%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026119) - BuildTime: 5s846ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5727996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s369ms - RowsReturned: 304.51K (304507) - RowsReturnedRate: 1.73 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s652ms - BuildRowsPartitioned: 7.03M (7026119) - HashBuckets: 16.78M (16777216) - HashCollisions: 13.94K (13942) - HashTablesBuildTime: 1s136ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m55s, non-child: 440.034ms, % non-child: 0.38%) - ConvertRowBatchTime: 171.203ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026119) - RowsReturnedRate: 60.66 K/sec RecvrSide: BytesReceived(4s000ms): 2.36 MB, 9.01 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 19.88 MB, 54.08 MB, 90.22 MB, 130.99 MB, 165.94 MB, 201.15 MB, 230.30 MB, 260.94 MB, 284.03 MB, 303.52 MB, 320.19 MB, 333.56 MB, 345.31 MB, 357.55 MB, 368.36 MB, 376.41 MB, 381.75 MB, 388.43 MB, 393.25 MB, 399.18 MB, 402.71 MB, 405.06 MB, 407.43 MB, 408.70 MB, 410.48 MB, 411.07 MB, 412.55 MB, 413.73 MB, 414.04 MB, 414.99 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.44 MB (435619378) - TotalGetBatchTime: 1m55s - DataArrivalTimer: 1m55s SenderSide: - DeserializeRowBatchTime: 1s940ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 52s847ms, non-child: 468.710ms, % non-child: 0.89%) - ConvertRowBatchTime: 139.256ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5727996) - RowsReturnedRate: 108.39 K/sec RecvrSide: BytesReceived(4s000ms): 6.78 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 11.88 MB, 39.55 MB, 55.42 MB, 69.37 MB, 88.35 MB, 108.59 MB, 129.08 MB, 143.53 MB, 159.16 MB, 169.33 MB, 177.25 MB, 187.68 MB, 193.66 MB, 197.75 MB, 198.78 MB, 200.38 MB, 201.45 MB, 202.12 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.12 MB (211935852) - TotalGetBatchTime: 52s705ms - DataArrivalTimer: 52s378ms SenderSide: - DeserializeRowBatchTime: 2s347ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 2s044ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 38.682ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000008a (host=vc1538.foo.com:22000):(Total: 4m16s, non-child: 13s753ms, % non-child: 5.36%) MemoryUsage(4s000ms): 36.38 MB, 68.36 MB, 73.77 MB, 74.27 MB, 103.41 MB, 106.97 MB, 109.86 MB, 110.92 MB, 111.67 MB, 111.93 MB, 112.63 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 112.69 MB, 150.36 MB, 208.51 MB, 247.04 MB, 281.92 MB, 303.79 MB, 329.42 MB, 349.42 MB, 377.42 MB, 381.42 MB, 401.92 MB, 413.42 MB, 414.07 MB, 430.17 MB, 446.17 MB, 446.17 MB, 446.17 MB, 446.17 MB, 446.17 MB, 457.67 MB, 478.17 MB, 478.17 MB, 479.01 MB, 480.42 MB, 482.53 MB, 483.54 MB, 485.04 MB, 485.33 MB, 485.79 MB, 485.98 MB, 486.54 MB, 685.50 MB, 736.95 MB, 751.97 MB, 773.07 MB, 794.13 MB, 802.88 MB, 795.29 MB, 785.60 MB, 798.01 MB, 804.70 MB, 804.76 MB, 805.01 MB, 812.78 MB, 818.44 MB, 812.69 MB, 805.44 MB, 793.80 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 826.77 MB (866935458) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.06 GB (1140227388) - RowsProduced: 302.51K (302506) - TotalNetworkReceiveTime: 3m48s - TotalNetworkSendTime: 4s277ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.21K (1209) - TotalThreadsTotalWallClockTime: 4m15s - TotalThreadsSysTime: 676.897ms - TotalThreadsUserTime: 7s520ms - TotalThreadsVoluntaryContextSwitches: 3.82K (3818) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 53s280ms - OpenTime: 3m5s - ExecTreeOpenTime: 3m4s - PrepareTime: 529.120ms - ExecTreePrepareTime: 39.349ms KrpcDataStreamSender (dst_id=23):(Total: 3s364ms, non-child: 3s364ms, % non-child: 100.00%) - BytesSent: 44.54 MB (46706623) - OverallThroughput: 13.24 MB/sec - PeakMemoryUsage: 71.61 MB (75085568) - RowsReturned: 302.51K (302506) - RpcRetry: 0 (0) - SerializeBatchTime: 3s155ms - UncompressedRowBatchSize: 82.34 MB (86342723) CodeGen:(Total: 1s227ms, non-child: 1s227ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 330.589ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 603.851ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 286.914ms HASH_JOIN_NODE (id=11):(Total: 3m58s, non-child: 1s500ms, % non-child: 0.63%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s278ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 302.51K (302506) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 123.177ms - RowsReturned: 302.51K (302506) - RowsReturnedRate: 1.27 K/sec Buffer pool: - AllocTime: 615.627ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 1s240ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 38.125ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m2s, non-child: 96.582ms, % non-child: 0.15%) - ConvertRowBatchTime: 11.881ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.38 K/sec RecvrSide: BytesReceived(2s000ms): 744.16 KB, 2.54 MB, 4.96 MB, 9.21 MB, 13.77 MB, 21.01 MB, 26.54 MB, 31.61 MB, 34.60 MB, 37.38 MB, 41.09 MB, 44.31 MB, 48.81 MB, 51.85 MB, 54.86 MB, 56.92 MB, 58.20 MB, 59.01 MB, 59.56 MB, 60.48 MB, 61.23 MB, 61.62 MB, 61.78 MB, 62.06 MB, 62.30 MB, 62.59 MB, 62.79 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.33 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m2s - DataArrivalTimer: 1m2s SenderSide: - DeserializeRowBatchTime: 1s548ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m53s, non-child: 96.030ms, % non-child: 0.06%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 52.673ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 307.29K (307287) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.672ms - RowsReturned: 302.51K (302506) - RowsReturnedRate: 1.74 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 52.025ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 239.741us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 22.887us, non-child: 22.887us, % non-child: 100.00%) - ConvertRowBatchTime: 12.492us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 5.33 M/sec RecvrSide: BytesReceived(2s000ms): 640.00 B, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.000us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 8.223us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m53s, non-child: 7s387ms, % non-child: 4.26%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026741) - BuildTime: 5s411ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5731761) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s335ms - RowsReturned: 307.29K (307287) - RowsReturnedRate: 1.77 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s389ms - BuildRowsPartitioned: 7.03M (7026741) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.04K (14044) - HashTablesBuildTime: 990.141ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m54s, non-child: 263.302ms, % non-child: 0.23%) - ConvertRowBatchTime: 168.906ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026741) - RowsReturnedRate: 61.56 K/sec RecvrSide: BytesReceived(4s000ms): 517.54 KB, 6.65 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 28.22 MB, 72.11 MB, 111.11 MB, 150.86 MB, 184.90 MB, 217.24 MB, 248.64 MB, 273.98 MB, 294.97 MB, 312.80 MB, 326.78 MB, 339.18 MB, 353.37 MB, 363.34 MB, 372.97 MB, 379.61 MB, 385.87 MB, 390.83 MB, 396.18 MB, 401.55 MB, 403.63 MB, 406.23 MB, 408.14 MB, 409.91 MB, 410.64 MB, 412.27 MB, 413.15 MB, 413.91 MB, 414.47 MB, 415.21 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.48 MB (435657942) - TotalGetBatchTime: 1m53s - DataArrivalTimer: 1m53s SenderSide: - DeserializeRowBatchTime: 3s340ms - NumBatchesAccepted: 633 (633) - NumBatchesDeferred: 39 (39) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 51s947ms, non-child: 559.191ms, % non-child: 1.08%) - ConvertRowBatchTime: 134.903ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5731761) - RowsReturnedRate: 110.34 K/sec RecvrSide: BytesReceived(4s000ms): 3.75 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 23.68 MB, 47.60 MB, 61.40 MB, 79.98 MB, 97.92 MB, 117.07 MB, 135.03 MB, 152.75 MB, 164.30 MB, 174.15 MB, 182.99 MB, 190.41 MB, 195.35 MB, 198.71 MB, 199.94 MB, 200.89 MB, 202.02 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.25 MB (212075157) - TotalGetBatchTime: 51s809ms - DataArrivalTimer: 51s388ms SenderSide: - DeserializeRowBatchTime: 4s041ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s316ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 51.890ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:327003730000007f (host=vc1515.foo.com:22000):(Total: 4m16s, non-child: 14s424ms, % non-child: 5.63%) MemoryUsage(4s000ms): 37.18 MB, 71.43 MB, 75.77 MB, 77.46 MB, 107.94 MB, 108.35 MB, 109.04 MB, 110.38 MB, 110.99 MB, 112.19 MB, 112.63 MB, 112.63 MB, 112.63 MB, 112.85 MB, 112.88 MB, 112.88 MB, 172.82 MB, 203.01 MB, 233.29 MB, 269.92 MB, 298.54 MB, 315.17 MB, 336.17 MB, 367.92 MB, 369.54 MB, 399.04 MB, 404.92 MB, 405.42 MB, 420.92 MB, 437.42 MB, 437.42 MB, 437.42 MB, 437.89 MB, 439.17 MB, 455.67 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 471.17 MB, 673.40 MB, 718.27 MB, 737.13 MB, 748.57 MB, 765.82 MB, 780.63 MB, 790.91 MB, 779.56 MB, 769.10 MB, 783.32 MB, 788.01 MB, 788.01 MB, 788.01 MB, 795.01 MB, 802.98 MB, 797.13 MB, 795.97 MB, 780.76 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 811.09 MB (850485610) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1131690364) - RowsProduced: 300.90K (300903) - TotalNetworkReceiveTime: 3m47s - TotalNetworkSendTime: 4s669ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.15K (1152) - TotalThreadsTotalWallClockTime: 4m15s - TotalThreadsSysTime: 699.894ms - TotalThreadsUserTime: 7s542ms - TotalThreadsVoluntaryContextSwitches: 4.05K (4055) Fragment Instance Lifecycle Timings: - ExecTime: 1m13s - ExecTreeExecTime: 56s201ms - OpenTime: 3m1s - ExecTreeOpenTime: 3m - PrepareTime: 1s029ms - ExecTreePrepareTime: 53.978ms KrpcDataStreamSender (dst_id=23):(Total: 3s684ms, non-child: 3s684ms, % non-child: 100.00%) - BytesSent: 44.30 MB (46449758) - OverallThroughput: 12.02 MB/sec - PeakMemoryUsage: 71.67 MB (75151104) - RowsReturned: 300.90K (300903) - RpcRetry: 0 (0) - SerializeBatchTime: 3s170ms - UncompressedRowBatchSize: 81.89 MB (85872653) CodeGen:(Total: 1s276ms, non-child: 1s276ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 303.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 572.499ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 396.671ms HASH_JOIN_NODE (id=11):(Total: 3m56s, non-child: 1s618ms, % non-child: 0.68%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 1s089ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 300.90K (300903) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 125.289ms - RowsReturned: 300.90K (300903) - RowsReturnedRate: 1.27 K/sec Buffer pool: - AllocTime: 542.134ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 972.055ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 117.211ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m1s, non-child: 64.301ms, % non-child: 0.10%) - ConvertRowBatchTime: 11.855ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.54 K/sec RecvrSide: BytesReceived(2s000ms): 1.41 MB, 3.30 MB, 5.81 MB, 10.58 MB, 15.58 MB, 22.44 MB, 28.11 MB, 32.46 MB, 34.72 MB, 37.98 MB, 42.07 MB, 45.44 MB, 49.84 MB, 52.96 MB, 55.37 MB, 56.79 MB, 58.08 MB, 58.97 MB, 59.81 MB, 60.93 MB, 61.34 MB, 61.66 MB, 61.78 MB, 62.10 MB, 62.34 MB, 62.63 MB, 62.79 MB, 62.83 MB, 62.99 MB, 63.03 MB, 63.28 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m1s - DataArrivalTimer: 1m1s SenderSide: - DeserializeRowBatchTime: 783.782ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=10):(Total: 2m53s, non-child: 272.339ms, % non-child: 0.16%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 213.729ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 305.69K (305687) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.401ms - RowsReturned: 300.90K (300903) - RowsReturnedRate: 1.73 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 185.613ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 27.661ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 17.697us, non-child: 17.697us, % non-child: 100.00%) - ConvertRowBatchTime: 7.548us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 6.89 M/sec RecvrSide: BytesReceived(2s000ms): 1.25 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.016us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 6.337us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m53s, non-child: 7s475ms, % non-child: 4.31%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7026875) - BuildTime: 5s822ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5733761) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s347ms - RowsReturned: 305.69K (305687) - RowsReturnedRate: 1.76 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s770ms - BuildRowsPartitioned: 7.03M (7026875) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.14K (14140) - HashTablesBuildTime: 998.632ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m51s, non-child: 389.107ms, % non-child: 0.35%) - ConvertRowBatchTime: 169.852ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7026875) - RowsReturnedRate: 63.27 K/sec RecvrSide: BytesReceived(4s000ms): 1.18 MB, 7.50 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 36.81 MB, 75.98 MB, 110.01 MB, 152.97 MB, 191.38 MB, 218.42 MB, 252.15 MB, 278.44 MB, 298.24 MB, 314.70 MB, 329.01 MB, 342.83 MB, 353.29 MB, 359.99 MB, 373.57 MB, 381.42 MB, 385.05 MB, 390.56 MB, 397.32 MB, 402.70 MB, 405.00 MB, 406.69 MB, 408.52 MB, 409.88 MB, 410.81 MB, 412.62 MB, 413.29 MB, 414.26 MB, 414.81 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.48 MB (435666250) - TotalGetBatchTime: 1m50s - DataArrivalTimer: 1m50s SenderSide: - DeserializeRowBatchTime: 2s574ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 54s974ms, non-child: 464.248ms, % non-child: 0.84%) - ConvertRowBatchTime: 135.602ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5733761) - RowsReturnedRate: 104.30 K/sec RecvrSide: BytesReceived(4s000ms): 5.34 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 22.73 MB, 34.13 MB, 50.55 MB, 64.83 MB, 83.64 MB, 100.13 MB, 121.82 MB, 137.93 MB, 156.34 MB, 165.67 MB, 176.98 MB, 186.11 MB, 192.06 MB, 196.34 MB, 199.32 MB, 201.13 MB, 201.73 MB, 202.23 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.32 MB (212149157) - TotalGetBatchTime: 54s835ms - DataArrivalTimer: 54s510ms SenderSide: - DeserializeRowBatchTime: 2s795ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 48 (48) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s714ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 212.676ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000082 (host=vc1542.foo.com:22000):(Total: 4m15s, non-child: 15s318ms, % non-child: 5.99%) MemoryUsage(4s000ms): 9.93 MB, 67.10 MB, 85.02 MB, 86.12 MB, 117.23 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 117.63 MB, 146.40 MB, 182.29 MB, 209.54 MB, 246.73 MB, 272.79 MB, 302.29 MB, 322.42 MB, 342.42 MB, 370.61 MB, 371.29 MB, 400.67 MB, 404.17 MB, 404.17 MB, 426.67 MB, 436.17 MB, 436.17 MB, 436.17 MB, 436.17 MB, 436.17 MB, 451.92 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.17 MB, 468.29 MB, 469.17 MB, 522.98 MB, 712.86 MB, 733.11 MB, 744.99 MB, 762.45 MB, 773.01 MB, 787.45 MB, 772.19 MB, 760.43 MB, 776.45 MB, 780.38 MB, 782.38 MB, 785.26 MB, 794.94 MB, 793.25 MB, 782.20 MB, 778.25 MB, 770.00 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 799.84 MB (838689154) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1113799755) - RowsProduced: 301.79K (301787) - TotalNetworkReceiveTime: 3m40s - TotalNetworkSendTime: 3s464ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.28K (1284) - TotalThreadsTotalWallClockTime: 4m11s - TotalThreadsSysTime: 615.907ms - TotalThreadsUserTime: 7s623ms - TotalThreadsVoluntaryContextSwitches: 4.29K (4293) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 50s108ms - OpenTime: 3m - ExecTreeOpenTime: 2m59s - PrepareTime: 4s173ms - ExecTreePrepareTime: 17.513ms KrpcDataStreamSender (dst_id=23):(Total: 8s770ms, non-child: 8s770ms, % non-child: 100.00%) - BytesSent: 44.45 MB (46608627) - OverallThroughput: 5.07 MB/sec - PeakMemoryUsage: 64.62 MB (67761920) - RowsReturned: 301.79K (301787) - RpcRetry: 0 (0) - SerializeBatchTime: 5s459ms - UncompressedRowBatchSize: 82.17 MB (86164248) CodeGen:(Total: 2s365ms, non-child: 2s365ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 574.847ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 949.718ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 786.323ms HASH_JOIN_NODE (id=11):(Total: 3m49s, non-child: 1s040ms, % non-child: 0.45%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 478.003ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.79K (301787) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 116.855ms - RowsReturned: 301.79K (301787) - RowsReturnedRate: 1.32 K/sec Buffer pool: - AllocTime: 243.727ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 272.183ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 205.133ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 55s106ms, non-child: 44.494ms, % non-child: 0.08%) - ConvertRowBatchTime: 10.699ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 7.29 K/sec RecvrSide: BytesReceived(1s000ms): 1.13 MB, 1.21 MB, 1.53 MB, 2.98 MB, 5.49 MB, 7.42 MB, 10.25 MB, 12.28 MB, 14.37 MB, 18.73 MB, 21.97 MB, 24.93 MB, 27.82 MB, 30.56 MB, 32.17 MB, 32.74 MB, 34.11 MB, 35.88 MB, 37.98 MB, 39.92 MB, 41.99 MB, 43.42 MB, 45.03 MB, 47.13 MB, 49.75 MB, 50.88 MB, 52.57 MB, 53.95 MB, 55.05 MB, 55.54 MB, 57.09 MB, 58.02 MB, 58.68 MB, 59.14 MB, 59.44 MB, 59.60 MB, 59.92 MB, 60.40 MB, 60.96 MB, 61.30 MB, 61.46 MB, 61.70 MB, 61.86 MB, 61.94 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.34 MB, 62.50 MB, 62.59 MB, 62.75 MB, 62.91 MB, 62.99 MB, 63.07 MB, 63.15 MB, 63.15 MB, 63.23 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 55s094ms - DataArrivalTimer: 55s062ms SenderSide: - DeserializeRowBatchTime: 2s024ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HASH_JOIN_NODE (id=10):(Total: 2m53s, non-child: 215.774ms, % non-child: 0.12%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 172.098ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.67K (306671) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 26.794ms - RowsReturned: 301.79K (301787) - RowsReturnedRate: 1.74 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 171.447ms - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 391.793us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 10.997us, non-child: 10.997us, % non-child: 100.00%) - ConvertRowBatchTime: 4.267us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 11.09 M/sec RecvrSide: BytesReceived(1s000ms): 0, 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 3.271us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 15.322us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m52s, non-child: 7s226ms, % non-child: 4.18%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7034479) - BuildTime: 5s497ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5730402) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s330ms - RowsReturned: 306.67K (306671) - RowsReturnedRate: 1.77 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s430ms - BuildRowsPartitioned: 7.03M (7034479) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.33K (14330) - HashTablesBuildTime: 994.015ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m56s, non-child: 629.917ms, % non-child: 0.54%) - ConvertRowBatchTime: 173.990ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7034479) - RowsReturnedRate: 60.19 K/sec RecvrSide: BytesReceived(4s000ms): 431.28 KB, 7.58 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 20.38 MB, 45.15 MB, 76.99 MB, 119.87 MB, 157.86 MB, 186.33 MB, 221.71 MB, 254.22 MB, 277.85 MB, 299.26 MB, 316.37 MB, 330.50 MB, 343.50 MB, 356.03 MB, 366.19 MB, 375.61 MB, 382.58 MB, 387.34 MB, 392.10 MB, 397.76 MB, 402.47 MB, 405.44 MB, 407.64 MB, 409.08 MB, 410.63 MB, 411.39 MB, 412.89 MB, 413.88 MB, 414.38 MB, 415.35 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.93 MB (436137698) - TotalGetBatchTime: 1m56s - DataArrivalTimer: 1m56s SenderSide: - DeserializeRowBatchTime: 3s676ms - NumBatchesAccepted: 632 (632) - NumBatchesDeferred: 36 (36) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 48s827ms, non-child: 416.681ms, % non-child: 0.85%) - ConvertRowBatchTime: 131.957ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5730402) - RowsReturnedRate: 117.36 K/sec RecvrSide: BytesReceived(4s000ms): 2.39 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 31.66 MB, 51.59 MB, 66.18 MB, 86.59 MB, 106.01 MB, 125.75 MB, 137.22 MB, 157.63 MB, 168.32 MB, 178.26 MB, 187.44 MB, 192.87 MB, 196.62 MB, 198.84 MB, 200.92 MB, 201.47 MB, 202.16 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.20 MB (212024874) - TotalGetBatchTime: 48s692ms - DataArrivalTimer: 48s410ms SenderSide: - DeserializeRowBatchTime: 3s358ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 56 (56) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s709ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 171.225ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000086 (host=vc1504.foo.com:22000):(Total: 4m15s, non-child: 8s779ms, % non-child: 3.44%) MemoryUsage(4s000ms): 38.31 MB, 72.51 MB, 75.16 MB, 82.29 MB, 108.54 MB, 108.54 MB, 109.34 MB, 110.16 MB, 111.07 MB, 111.75 MB, 112.19 MB, 112.19 MB, 112.19 MB, 112.19 MB, 112.19 MB, 151.67 MB, 181.54 MB, 212.79 MB, 245.92 MB, 270.32 MB, 304.92 MB, 327.42 MB, 339.92 MB, 371.42 MB, 371.42 MB, 401.17 MB, 403.42 MB, 403.42 MB, 426.17 MB, 435.92 MB, 436.42 MB, 436.42 MB, 436.42 MB, 436.42 MB, 454.92 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 468.42 MB, 512.54 MB, 713.62 MB, 735.18 MB, 746.13 MB, 760.63 MB, 773.38 MB, 774.82 MB, 747.28 MB, 758.13 MB, 773.51 MB, 777.01 MB, 777.13 MB, 777.27 MB, 785.61 MB, 794.17 MB, 787.49 MB, 783.15 MB, 767.96 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 802.35 MB (841326930) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1096043355) - RowsProduced: 301.48K (301479) - TotalNetworkReceiveTime: 3m55s - TotalNetworkSendTime: 3s496ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.09K (1095) - TotalThreadsTotalWallClockTime: 4m14s - TotalThreadsSysTime: 587.910ms - TotalThreadsUserTime: 7s620ms - TotalThreadsVoluntaryContextSwitches: 3.31K (3310) Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 59s178ms - OpenTime: 3m4s - ExecTreeOpenTime: 3m3s - PrepareTime: 1s016ms - ExecTreePrepareTime: 231.928ms KrpcDataStreamSender (dst_id=23):(Total: 2s759ms, non-child: 2s759ms, % non-child: 100.00%) - BytesSent: 44.38 MB (46539957) - OverallThroughput: 16.08 MB/sec - PeakMemoryUsage: 69.69 MB (73070336) - RowsReturned: 301.48K (301479) - RpcRetry: 0 (0) - SerializeBatchTime: 2s340ms - UncompressedRowBatchSize: 82.06 MB (86044340) CodeGen:(Total: 1s101ms, non-child: 1s101ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 286.602ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 520.667ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 291.620ms HASH_JOIN_NODE (id=11):(Total: 4m2s, non-child: 1s077ms, % non-child: 0.44%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 465.387ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.48K (301479) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 128.131ms - RowsReturned: 301.48K (301479) - RowsReturnedRate: 1.24 K/sec Buffer pool: - AllocTime: 43.753ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 430.842ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 33.774ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 58s745ms, non-child: 17.112ms, % non-child: 0.03%) - ConvertRowBatchTime: 11.689ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.84 K/sec RecvrSide: BytesReceived(1s000ms): 993.22 KB, 2.10 MB, 2.82 MB, 3.71 MB, 5.16 MB, 7.34 MB, 10.42 MB, 12.60 MB, 14.69 MB, 19.14 MB, 21.97 MB, 24.25 MB, 27.50 MB, 30.00 MB, 32.42 MB, 33.63 MB, 34.60 MB, 36.12 MB, 37.90 MB, 39.84 MB, 41.75 MB, 43.18 MB, 45.20 MB, 47.05 MB, 48.88 MB, 50.56 MB, 51.85 MB, 53.66 MB, 55.13 MB, 56.61 MB, 57.49 MB, 58.20 MB, 58.52 MB, 59.01 MB, 59.17 MB, 59.52 MB, 59.76 MB, 60.08 MB, 60.88 MB, 61.33 MB, 61.46 MB, 61.54 MB, 61.78 MB, 61.94 MB, 62.02 MB, 62.18 MB, 62.26 MB, 62.34 MB, 62.50 MB, 62.50 MB, 62.67 MB, 62.67 MB, 62.83 MB, 62.91 MB, 63.15 MB, 63.15 MB, 63.31 MB, 63.31 MB, 63.31 MB, 63.34 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 58s732ms - DataArrivalTimer: 58s728ms SenderSide: - DeserializeRowBatchTime: 878.696ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 4 (4) - NumEarlySenders: 4 (4) HASH_JOIN_NODE (id=10):(Total: 3m3s, non-child: 117.564ms, % non-child: 0.06%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 551.353us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.27K (306266) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 28.097ms - RowsReturned: 301.48K (301479) - RowsReturnedRate: 1.65 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 69.066us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.284us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 15.868us, non-child: 15.868us, % non-child: 100.00%) - ConvertRowBatchTime: 6.204us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 7.69 M/sec RecvrSide: BytesReceived(1s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.443us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 8.814us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 3m2s, non-child: 6s275ms, % non-child: 3.43%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.02M (7023314) - BuildTime: 4s441ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5726113) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s379ms - RowsReturned: 306.27K (306266) - RowsReturnedRate: 1.67 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 3s598ms - BuildRowsPartitioned: 7.02M (7023314) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.24K (14245) - HashTablesBuildTime: 791.386ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m58s, non-child: 295.203ms, % non-child: 0.25%) - ConvertRowBatchTime: 175.880ms - PeakMemoryUsage: 0 - RowsReturned: 7.02M (7023314) - RowsReturnedRate: 59.26 K/sec RecvrSide: BytesReceived(4s000ms): 1.60 MB, 7.83 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 24.77 MB, 43.30 MB, 82.72 MB, 121.13 MB, 156.59 MB, 193.49 MB, 224.65 MB, 254.09 MB, 280.13 MB, 300.10 MB, 316.38 MB, 329.69 MB, 343.13 MB, 355.95 MB, 365.51 MB, 374.85 MB, 381.56 MB, 387.26 MB, 392.14 MB, 397.82 MB, 402.13 MB, 404.42 MB, 407.10 MB, 408.45 MB, 410.16 MB, 410.84 MB, 412.26 MB, 413.35 MB, 413.68 MB, 414.73 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.27 MB (435445468) - TotalGetBatchTime: 1m58s - DataArrivalTimer: 1m58s SenderSide: - DeserializeRowBatchTime: 1s718ms - NumBatchesAccepted: 631 (631) - NumBatchesDeferred: 35 (35) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s148ms, non-child: 598.340ms, % non-child: 1.03%) - ConvertRowBatchTime: 139.161ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5726113) - RowsReturnedRate: 98.47 K/sec RecvrSide: BytesReceived(4s000ms): 5.90 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 31.50 MB, 50.95 MB, 65.46 MB, 84.76 MB, 102.68 MB, 123.90 MB, 139.67 MB, 155.33 MB, 166.83 MB, 176.58 MB, 184.99 MB, 191.76 MB, 196.29 MB, 198.93 MB, 200.42 MB, 201.21 MB, 201.97 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.05 MB (211866181) - TotalGetBatchTime: 58s005ms - DataArrivalTimer: 57s550ms SenderSide: - DeserializeRowBatchTime: 4s084ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 33 (33) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 697.425ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 8.981us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Instance b04615c310d227c4:3270037300000080 (host=vc1534.foo.com:22000):(Total: 4m14s, non-child: 9s495ms, % non-child: 3.73%) MemoryUsage(4s000ms): 22.59 MB, 76.70 MB, 78.16 MB, 87.24 MB, 111.09 MB, 111.39 MB, 111.51 MB, 112.04 MB, 112.45 MB, 112.76 MB, 112.86 MB, 113.02 MB, 113.02 MB, 113.05 MB, 113.27 MB, 113.27 MB, 177.90 MB, 222.17 MB, 256.29 MB, 277.42 MB, 312.42 MB, 336.92 MB, 352.92 MB, 376.92 MB, 380.42 MB, 408.92 MB, 408.92 MB, 408.92 MB, 437.04 MB, 441.92 MB, 442.51 MB, 442.67 MB, 442.67 MB, 442.67 MB, 468.67 MB, 474.79 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 475.67 MB, 608.01 MB, 720.91 MB, 741.95 MB, 754.43 MB, 772.73 MB, 783.63 MB, 790.64 MB, 761.85 MB, 770.76 MB, 786.70 MB, 788.26 MB, 788.26 MB, 789.63 MB, 797.66 MB, 798.25 MB, 796.29 MB, 789.31 MB, 776.51 MB ThreadUsage(4s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 813.26 MB (852763058) - PeakReservation: 657.94 MB (689897472) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1019.31 MB (1068824164) - RowsProduced: 301.28K (301279) - TotalNetworkReceiveTime: 3m51s - TotalNetworkSendTime: 4s755ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.13K (1128) - TotalThreadsTotalWallClockTime: 4m12s - TotalThreadsSysTime: 610.907ms - TotalThreadsUserTime: 7s426ms - TotalThreadsVoluntaryContextSwitches: 3.31K (3305) Fragment Instance Lifecycle Timings: - ExecTime: 1m11s - ExecTreeExecTime: 1m - OpenTime: 3m - ExecTreeOpenTime: 2m59s - PrepareTime: 2s257ms - ExecTreePrepareTime: 200.165ms KrpcDataStreamSender (dst_id=23):(Total: 3s628ms, non-child: 3s628ms, % non-child: 100.00%) - BytesSent: 44.33 MB (46482671) - OverallThroughput: 12.22 MB/sec - PeakMemoryUsage: 71.59 MB (75069184) - RowsReturned: 301.28K (301279) - RpcRetry: 0 (0) - SerializeBatchTime: 2s034ms - UncompressedRowBatchSize: 81.96 MB (85938500) CodeGen:(Total: 1s331ms, non-child: 1s331ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 311.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 130 (130) - NumInstructions: 7.26K (7263) - OptimizationTime: 653.536ms - PeakMemoryUsage: 3.55 MB (3718656) - PrepareTime: 358.940ms HASH_JOIN_NODE (id=11):(Total: 4m, non-child: 1s098ms, % non-child: 0.46%) ExecOption: Probe Side Codegen Enabled - BuildRows: 402.00K (402000) - BuildTime: 826.253ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 80.07 MB (83962112) - ProbeRows: 301.28K (301279) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.943ms - RowsReturned: 301.28K (301279) - RowsReturnedRate: 1.25 K/sec Buffer pool: - AllocTime: 169.396ms - CumulativeAllocationBytes: 80.00 MB (83886080) - CumulativeAllocations: 40 (40) - PeakReservation: 80.00 MB (83886080) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 80.00 MB (83886080) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=11): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 776.238ms - BuildRowsPartitioned: 402.00K (402000) - HashBuckets: 1.05M (1048576) - HashCollisions: 0 (0) - HashTablesBuildTime: 49.354ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 1m, non-child: 75.019ms, % non-child: 0.12%) - ConvertRowBatchTime: 11.851ms - PeakMemoryUsage: 0 - RowsReturned: 402.00K (402000) - RowsReturnedRate: 6.67 K/sec RecvrSide: BytesReceived(2s000ms): 1.61 MB, 4.35 MB, 8.80 MB, 13.65 MB, 20.65 MB, 26.49 MB, 30.81 MB, 34.27 MB, 37.25 MB, 40.96 MB, 44.15 MB, 48.64 MB, 51.69 MB, 53.79 MB, 56.89 MB, 58.20 MB, 58.97 MB, 59.52 MB, 60.44 MB, 61.19 MB, 61.46 MB, 61.82 MB, 62.06 MB, 62.30 MB, 62.54 MB, 62.79 MB, 62.87 MB, 63.07 MB, 63.15 MB, 63.27 MB, 63.36 MB, 63.36 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 63.36 MB (66436789) - TotalGetBatchTime: 1m - DataArrivalTimer: 1m SenderSide: - DeserializeRowBatchTime: 851.662ms - NumBatchesAccepted: 398 (398) - NumBatchesDeferred: 3 (3) - NumEarlySenders: 3 (3) HASH_JOIN_NODE (id=10):(Total: 2m58s, non-child: 146.327ms, % non-child: 0.08%) ExecOption: Probe Side Codegen Enabled - BuildRows: 122 (122) - BuildTime: 625.522us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2091264) - ProbeRows: 306.03K (306034) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 27.088ms - RowsReturned: 301.28K (301279) - RowsReturnedRate: 1.68 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 125.240us - BuildRowsPartitioned: 122 (122) - HashBuckets: 256 (256) - HashCollisions: 0 (0) - HashTablesBuildTime: 210.328us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=20):(Total: 14.574us, non-child: 14.574us, % non-child: 100.00%) - ConvertRowBatchTime: 5.175us - PeakMemoryUsage: 0 - RowsReturned: 122 (122) - RowsReturnedRate: 8.37 M/sec RecvrSide: BytesReceived(2s000ms): 0, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB, 2.50 KB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 2.50 KB (2562) - TotalGetBatchTime: 4.093us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 10.553us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HASH_JOIN_NODE (id=9):(Total: 2m58s, non-child: 7s239ms, % non-child: 4.05%) ExecOption: Probe Side Codegen Enabled - BuildRows: 7.03M (7031371) - BuildTime: 5s511ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 576.10 MB (604084480) - ProbeRows: 5.73M (5731404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s349ms - RowsReturned: 306.03K (306034) - RowsReturnedRate: 1.71 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 0 of 3 Runtime Filters Published, 3 Disabled - BuildRowsPartitionTime: 4s726ms - BuildRowsPartitioned: 7.03M (7031371) - HashBuckets: 16.78M (16777216) - HashCollisions: 14.36K (14361) - HashTablesBuildTime: 756.954ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 47.12 KB (48256) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=19):(Total: 1m52s, non-child: 249.429ms, % non-child: 0.22%) - ConvertRowBatchTime: 176.032ms - PeakMemoryUsage: 0 - RowsReturned: 7.03M (7031371) - RowsReturnedRate: 62.46 K/sec RecvrSide: BytesReceived(4s000ms): 2.44 MB, 9.01 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 9.43 MB, 50.04 MB, 89.96 MB, 131.83 MB, 166.28 MB, 201.66 MB, 233.08 MB, 262.14 MB, 286.07 MB, 304.60 MB, 320.18 MB, 333.08 MB, 346.84 MB, 358.59 MB, 368.58 MB, 376.88 MB, 383.24 MB, 389.05 MB, 394.04 MB, 399.40 MB, 403.41 MB, 405.93 MB, 407.87 MB, 409.24 MB, 410.74 MB, 411.57 MB, 412.82 MB, 414.00 MB, 414.55 MB, 415.29 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 415.75 MB (435945002) - TotalGetBatchTime: 1m52s - DataArrivalTimer: 1m52s SenderSide: - DeserializeRowBatchTime: 2s499ms - NumBatchesAccepted: 634 (634) - NumBatchesDeferred: 38 (38) - NumEarlySenders: 0 (0) EXCHANGE_NODE (id=18):(Total: 58s942ms, non-child: 390.239ms, % non-child: 0.66%) - ConvertRowBatchTime: 134.181ms - PeakMemoryUsage: 0 - RowsReturned: 5.73M (5731404) - RowsReturnedRate: 97.24 K/sec RecvrSide: BytesReceived(4s000ms): 6.06 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 9.57 MB, 22.57 MB, 37.96 MB, 54.46 MB, 69.77 MB, 89.47 MB, 107.41 MB, 128.14 MB, 144.71 MB, 158.97 MB, 169.62 MB, 179.32 MB, 187.54 MB, 193.13 MB, 197.65 MB, 199.81 MB, 201.08 MB, 201.83 MB, 202.24 MB - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 202.24 MB (212061948) - TotalGetBatchTime: 58s805ms - DataArrivalTimer: 58s552ms SenderSide: - DeserializeRowBatchTime: 3s068ms - NumBatchesAccepted: 341 (341) - NumBatchesDeferred: 34 (34) - NumEarlySenders: 0 (0) Buffer pool: - AllocTime: 1s725ms - CumulativeAllocationBytes: 576.00 MB (603979776) - CumulativeAllocations: 176 (176) - PeakReservation: 576.00 MB (603979776) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 576.00 MB (603979776) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Buffer pool: - AllocTime: 87.753us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Averaged Fragment F01:(Total: 3m53s, non-child: 3m43s, % non-child: 96.01%) split sizes: min: 5.28 GB, max: 5.34 GB, avg: 5.28 GB, stddev: 11.00 MB completion times: min:3m30s max:4m22s mean: 3m53s stddev:13s344ms execution rates: min:20.58 MB/sec max:25.63 MB/sec mean:23.23 MB/sec stddev:1.31 MB/sec num instances: 37 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 52.35 MB (54892926) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1093465301) - RowsProduced: 5.73M (5728009) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m10s - TotalStorageWaitTime: 1s161ms - TotalThreadsInvoluntaryContextSwitches: 1.51K (1511) - TotalThreadsTotalWallClockTime: 7m31s - TotalThreadsSysTime: 947.774ms - TotalThreadsUserTime: 5s150ms - TotalThreadsVoluntaryContextSwitches: 23.93K (23925) Fragment Instance Lifecycle Timings: - ExecTime: 3m52s - ExecTreeExecTime: 5s417ms - OpenTime: 246.688ms - ExecTreeOpenTime: 3.033ms - PrepareTime: 875.135ms - ExecTreePrepareTime: 141.051ms KrpcDataStreamSender (dst_id=18):(Total: 3s183ms, non-child: 3s183ms, % non-child: 100.00%) - BytesSent: 129.37 MB (135656565) - OverallThroughput: 49.54 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.73M (5728009) - RpcRetry: 0 (0) - SerializeBatchTime: 2s653ms - UncompressedRowBatchSize: 202.12 MB (211936349) CodeGen:(Total: 435.378ms, non-child: 435.378ms, % non-child: 100.00%) - CodegenTime: 5.930ms - CompileTime: 68.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 162.077ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 189.813ms HDFS_SCAN_NODE (id=1):(Total: 5s688ms, non-child: 5s688ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 137.98 MB (144680863) - BytesReadDataNodeCache: 0 - BytesReadLocal: 133.03 MB (139488307) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 133.03 MB (139488307) - CachedFileHandlesHitCount: 928 (928) - CachedFileHandlesMissCount: 33 (33) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s561ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.84 MB (11370071) - PerReadThreadRawHdfsThroughput: 162.33 MB/sec - RemoteScanRanges: 99 (99) - RowBatchQueueGetWaitTime: 4s595ms - RowBatchQueuePutWaitTime: 3m1s - RowsRead: 5.73M (5728009) - RowsReturned: 5.73M (5728009) - RowsReturnedRate: 1.26 M/sec - ScanRangesComplete: 2.05K (2054) - ScannerThreadsInvoluntaryContextSwitches: 614 (614) - ScannerThreadsTotalWallClockTime: 3m39s - MaterializeTupleTime(*): 25s492ms - ScannerThreadsSysTime: 464.793ms - ScannerThreadsUserTime: 1s851ms - ScannerThreadsVoluntaryContextSwitches: 11.25K (11254) - TotalRawHdfsReadTime(*): 855.335ms - TotalReadThroughput: 637.79 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1987700) - Rows rejected: 0 (0) - Rows total: 5.73M (5728009) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2054) - RowGroups processed: 4.11K (4106) - RowGroups rejected: 0 (0) - RowGroups total: 5.68K (5676) - Rows processed: 1.99M (1987700) - Rows rejected: 0 (0) - Rows total: 5.73M (5728009) - Splits processed: 2.01K (2013) - Splits rejected: 1.89K (1890) - Splits total: 2.05K (2054) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1987700) - Rows rejected: 0 (0) - Rows total: 5.73M (5728009) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1987700) - Rows rejected: 0 (0) - Rows total: 5.73M (5728009) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1987700) - Rows rejected: 0 (0) - Rows total: 5.73M (5728009) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Fragment F01: Instance b04615c310d227c4:3270037300000042 (host=vc1536.foo.com:22000):(Total: 4m22s, non-child: 4m9s, % non-child: 95.29%) Hdfs split stats (:<# splits>/): 1:274/734.47 MB 2:256/648.30 MB 4:228/729.73 MB 7:253/632.76 MB 6:229/588.43 MB -1:34/90.13 MB 0:260/650.65 MB 5:249/624.78 MB 3:258/703.53 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m4s Filter 12 arrival: 3m3s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(8s000ms): 19.19 MB, 40.80 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.01 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 48.13 MB, 30.24 MB, 25.81 MB, 19.48 MB, 23.42 MB, 25.14 MB, 24.44 MB, 18.21 MB, 12.53 MB, 9.26 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.13 MB (50470391) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1126889674) - RowsProduced: 5.55M (5548341) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m20s - TotalStorageWaitTime: 931.065ms - TotalThreadsInvoluntaryContextSwitches: 1.38K (1377) - TotalThreadsTotalWallClockTime: 8m18s - TotalThreadsSysTime: 1s047ms - TotalThreadsUserTime: 5s293ms - TotalThreadsVoluntaryContextSwitches: 27.73K (27730) Fragment Instance Lifecycle Timings: - ExecTime: 4m21s - ExecTreeExecTime: 8s342ms - OpenTime: 307.509ms - ExecTreeOpenTime: 3.268ms - PrepareTime: 685.252ms - ExecTreePrepareTime: 173.166ms KrpcDataStreamSender (dst_id=18):(Total: 3s186ms, non-child: 3s186ms, % non-child: 100.00%) - BytesSent: 125.65 MB (131753366) - OverallThroughput: 39.44 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.55M (5548341) - RpcRetry: 0 (0) - SerializeBatchTime: 2s855ms - UncompressedRowBatchSize: 195.78 MB (205288617) CodeGen:(Total: 482.602ms, non-child: 482.602ms, % non-child: 100.00%) - CodegenTime: 1.898ms - CompileTime: 97.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 203.007ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 172.131ms HDFS_SCAN_NODE (id=1):(Total: 8s677ms, non-child: 8s677ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:274/734.47 MB 2:256/648.30 MB 4:228/729.73 MB 7:253/632.76 MB 6:229/588.43 MB -1:34/90.13 MB 0:260/650.65 MB 5:249/624.78 MB 3:258/703.53 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.36% 1:0.6356% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:165 PARQUET/Unknown(Skipped):1876 BytesRead(4s000ms): 6.14 MB, 21.67 MB, 27.01 MB, 30.14 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.98 MB, 32.50 MB, 37.18 MB, 43.82 MB, 49.13 MB, 53.00 MB, 59.64 MB, 68.88 MB, 75.43 MB, 86.88 MB, 97.75 MB, 109.32 MB, 120.13 MB - FooterProcessingTime: (Avg: 2.028ms ; Min: 288.327us ; Max: 43.661ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 130.26 MB (136582897) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.92 MB (130987305) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.92 MB (130987305) - CachedFileHandlesHitCount: 904 (904) - CachedFileHandlesMissCount: 36 (36) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s143ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.00 MB (6294592) - PerReadThreadRawHdfsThroughput: 141.58 MB/sec - RemoteScanRanges: 105 (105) - RowBatchQueueGetWaitTime: 7s587ms - RowBatchQueuePutWaitTime: 2m56s - RowsRead: 5.55M (5548341) - RowsReturned: 5.55M (5548341) - RowsReturnedRate: 639.42 K/sec - ScanRangesComplete: 2.04K (2041) - ScannerThreadsInvoluntaryContextSwitches: 474 (474) - ScannerThreadsTotalWallClockTime: 3m56s - MaterializeTupleTime(*): 42s105ms - ScannerThreadsSysTime: 490.925ms - ScannerThreadsUserTime: 1s952ms - ScannerThreadsVoluntaryContextSwitches: 13.34K (13342) - TotalRawHdfsReadTime(*): 920.042ms - TotalReadThroughput: 562.79 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017882) - Rows rejected: 0 (0) - Rows total: 5.55M (5548341) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.04K (2041) - RowGroups processed: 4.08K (4075) - RowGroups rejected: 1 (1) - RowGroups total: 5.50K (5496) - Rows processed: 2.02M (2017882) - Rows rejected: 0 (0) - Rows total: 5.55M (5548341) - Splits processed: 2.00K (2000) - Splits rejected: 1.88K (1876) - Splits total: 2.04K (2041) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017882) - Rows rejected: 0 (0) - Rows total: 5.55M (5548341) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017882) - Rows rejected: 0 (0) - Rows total: 5.55M (5548341) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017882) - Rows rejected: 0 (0) - Rows total: 5.55M (5548341) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000029 (host=vc1542.foo.com:22000):(Total: 4m18s, non-child: 3m57s, % non-child: 91.98%) Hdfs split stats (:<# splits>/): 4:236/631.78 MB 6:264/681.69 MB 3:241/627.73 MB 5:270/696.41 MB 1:245/659.85 MB -1:33/85.02 MB 0:229/690.08 MB 2:259/693.21 MB 7:254/637.45 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m4s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s Filter 12 arrival: 3m3s MemoryUsage(8s000ms): 6.33 MB, 30.79 MB, 29.27 MB, 75.12 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.73 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 29.06 MB, 21.77 MB, 21.59 MB, 25.56 MB, 27.54 MB, 23.45 MB, 18.11 MB, 25.25 MB, 13.50 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 78.85 MB (82677683) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1113799755) - RowsProduced: 5.68M (5684290) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m48s - TotalStorageWaitTime: 2s160ms - TotalThreadsInvoluntaryContextSwitches: 1.27K (1269) - TotalThreadsTotalWallClockTime: 8m19s - TotalThreadsSysTime: 1s013ms - TotalThreadsUserTime: 5s500ms - TotalThreadsVoluntaryContextSwitches: 30.31K (30313) Fragment Instance Lifecycle Timings: - ExecTime: 4m14s - ExecTreeExecTime: 10s698ms - OpenTime: 419.935ms - ExecTreeOpenTime: 3.344ms - PrepareTime: 4s071ms - ExecTreePrepareTime: 200.196ms KrpcDataStreamSender (dst_id=18):(Total: 8s684ms, non-child: 8s684ms, % non-child: 100.00%) - BytesSent: 127.61 MB (133810923) - OverallThroughput: 14.69 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.68M (5684290) - RpcRetry: 0 (0) - SerializeBatchTime: 5s391ms - UncompressedRowBatchSize: 200.58 MB (210318730) CodeGen:(Total: 973.459ms, non-child: 973.459ms, % non-child: 100.00%) - CodegenTime: 77.275ms - CompileTime: 176.062ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 227.297ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 526.236ms HDFS_SCAN_NODE (id=1):(Total: 11s084ms, non-child: 11s084ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:236/631.78 MB 6:264/681.69 MB 3:241/627.73 MB 5:270/696.41 MB 1:245/659.85 MB -1:33/85.02 MB 0:229/690.08 MB 2:259/693.21 MB 7:254/637.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.39% 1:0.6148% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:156 PARQUET/Unknown(Skipped):1875 BytesRead(4s000ms): 0, 2.89 MB, 8.12 MB, 14.69 MB, 17.29 MB, 27.65 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.23 MB, 49.99 MB, 50.45 MB, 53.80 MB, 59.10 MB, 65.55 MB, 71.27 MB, 75.37 MB, 81.79 MB, 86.64 MB, 93.19 MB, 101.64 MB, 113.73 MB, 128.34 MB, 132.70 MB, 137.79 MB, 145.65 MB - FooterProcessingTime: (Avg: 4.762ms ; Min: 301.988us ; Max: 164.077ms ; Number of samples: 156) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 152.75 MB (160168287) - BytesReadDataNodeCache: 0 - BytesReadLocal: 147.92 MB (155105963) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 147.92 MB (155105963) - CachedFileHandlesHitCount: 887 (887) - CachedFileHandlesMissCount: 31 (31) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s473ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 156 (156) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 36.72 MB (38501884) - PerReadThreadRawHdfsThroughput: 148.62 MB/sec - RemoteScanRanges: 93 (93) - RowBatchQueueGetWaitTime: 9s304ms - RowBatchQueuePutWaitTime: 2m47s - RowsRead: 5.68M (5684290) - RowsReturned: 5.68M (5684290) - RowsReturnedRate: 512.81 K/sec - ScanRangesComplete: 2.03K (2031) - ScannerThreadsInvoluntaryContextSwitches: 414 (414) - ScannerThreadsTotalWallClockTime: 4m5s - MaterializeTupleTime(*): 53s528ms - ScannerThreadsSysTime: 512.922ms - ScannerThreadsUserTime: 1s944ms - ScannerThreadsVoluntaryContextSwitches: 14.42K (14417) - TotalRawHdfsReadTime(*): 1s027ms - TotalReadThroughput: 629.43 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1954024) - Rows rejected: 0 (0) - Rows total: 5.68M (5684290) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.03K (2031) - RowGroups processed: 4.20K (4199) - RowGroups rejected: 1 (1) - RowGroups total: 5.63K (5631) - Rows processed: 1.95M (1954024) - Rows rejected: 0 (0) - Rows total: 5.68M (5684290) - Splits processed: 2.00K (1996) - Splits rejected: 1.88K (1875) - Splits total: 2.03K (2031) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1954024) - Rows rejected: 0 (0) - Rows total: 5.68M (5684290) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1954024) - Rows rejected: 0 (0) - Rows total: 5.68M (5684290) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1954024) - Rows rejected: 0 (0) - Rows total: 5.68M (5684290) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000026 (host=vc1515.foo.com:22000):(Total: 4m14s, non-child: 4m, % non-child: 94.72%) Hdfs split stats (:<# splits>/): 4:247/641.88 MB 5:210/527.67 MB 1:255/762.05 MB 3:260/708.15 MB -1:32/86.01 MB 0:286/711.38 MB 7:239/615.02 MB 2:248/650.39 MB 6:269/700.29 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s Filter 14 arrival: 3m1s MemoryUsage(4s000ms): 14.56 MB, 27.66 MB, 19.84 MB, 37.59 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.43 MB, 47.50 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.56 MB, 47.30 MB, 43.70 MB, 21.56 MB, 22.45 MB, 32.65 MB, 15.52 MB, 20.38 MB, 30.53 MB, 17.79 MB, 24.01 MB, 23.98 MB, 27.68 MB, 21.23 MB, 21.37 MB, 24.16 MB, 15.70 MB, 12.66 MB, 10.07 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.56 MB (49875156) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1131690364) - RowsProduced: 5.58M (5577077) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m3s - TotalStorageWaitTime: 965.538ms - TotalThreadsInvoluntaryContextSwitches: 1.16K (1156) - TotalThreadsTotalWallClockTime: 8m15s - TotalThreadsSysTime: 999.847ms - TotalThreadsUserTime: 5s363ms - TotalThreadsVoluntaryContextSwitches: 28.55K (28549) Fragment Instance Lifecycle Timings: - ExecTime: 4m13s - ExecTreeExecTime: 8s945ms - OpenTime: 248.883ms - ExecTreeOpenTime: 3.131ms - PrepareTime: 916.395ms - ExecTreePrepareTime: 144.046ms KrpcDataStreamSender (dst_id=18):(Total: 3s756ms, non-child: 3s756ms, % non-child: 100.00%) - BytesSent: 126.39 MB (132529839) - OverallThroughput: 33.65 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.58M (5577077) - RpcRetry: 0 (0) - SerializeBatchTime: 3s218ms - UncompressedRowBatchSize: 196.79 MB (206351849) CodeGen:(Total: 460.804ms, non-child: 460.804ms, % non-child: 100.00%) - CodegenTime: 3.839ms - CompileTime: 82.385ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 141.276ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 222.039ms HDFS_SCAN_NODE (id=1):(Total: 9s221ms, non-child: 9s221ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:247/641.88 MB 5:210/527.67 MB 1:255/762.05 MB 3:260/708.15 MB -1:32/86.01 MB 0:286/711.38 MB 7:239/615.02 MB 2:248/650.39 MB 6:269/700.29 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:99.59% 1:0.4132% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:165 PARQUET/Unknown(Skipped):1881 BytesRead(4s000ms): 3.87 MB, 12.14 MB, 20.65 MB, 28.24 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.62 MB, 30.73 MB, 31.48 MB, 32.20 MB, 38.50 MB, 44.86 MB, 49.69 MB, 53.22 MB, 59.40 MB, 67.39 MB, 71.58 MB, 80.73 MB, 92.93 MB, 106.40 MB, 115.23 MB, 123.25 MB - FooterProcessingTime: (Avg: 2.458ms ; Min: 130.585us ; Max: 77.684ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 134.68 MB (141226269) - BytesReadDataNodeCache: 0 - BytesReadLocal: 131.53 MB (137923878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 131.53 MB (137923878) - CachedFileHandlesHitCount: 958 (958) - CachedFileHandlesMissCount: 25 (25) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s722ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.10 MB (6392521) - PerReadThreadRawHdfsThroughput: 158.25 MB/sec - RemoteScanRanges: 75 (75) - RowBatchQueueGetWaitTime: 8s060ms - RowBatchQueuePutWaitTime: 2m57s - RowsRead: 5.58M (5577077) - RowsReturned: 5.58M (5577077) - RowsReturnedRate: 604.81 K/sec - ScanRangesComplete: 2.05K (2046) - ScannerThreadsInvoluntaryContextSwitches: 412 (412) - ScannerThreadsTotalWallClockTime: 4m2s - MaterializeTupleTime(*): 44s163ms - ScannerThreadsSysTime: 481.926ms - ScannerThreadsUserTime: 1s958ms - ScannerThreadsVoluntaryContextSwitches: 13.57K (13575) - TotalRawHdfsReadTime(*): 851.064ms - TotalReadThroughput: 567.56 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2001874) - Rows rejected: 0 (0) - Rows total: 5.58M (5577077) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2046) - RowGroups processed: 4.11K (4106) - RowGroups rejected: 1 (1) - RowGroups total: 5.53K (5533) - Rows processed: 2.00M (2001874) - Rows rejected: 0 (0) - Rows total: 5.58M (5577077) - Splits processed: 2.00K (2005) - Splits rejected: 1.88K (1881) - Splits total: 2.05K (2046) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2001874) - Rows rejected: 0 (0) - Rows total: 5.58M (5577077) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2001874) - Rows rejected: 0 (0) - Rows total: 5.58M (5577077) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2001874) - Rows rejected: 0 (0) - Rows total: 5.58M (5577077) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000041 (host=vc1537.foo.com:22000):(Total: 4m12s, non-child: 3m58s, % non-child: 94.47%) Hdfs split stats (:<# splits>/): 3:269/770.65 MB 2:251/656.75 MB 1:259/671.73 MB 6:247/613.44 MB 7:240/575.90 MB -1:36/88.03 MB 0:247/642.04 MB 4:270/719.22 MB 5:249/664.39 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m3s Filter 12 arrival: 3m2s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 11.23 MB, 28.52 MB, 20.71 MB, 14.26 MB, 18.55 MB, 29.65 MB, 46.25 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.23 MB, 46.25 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 46.36 MB, 43.73 MB, 24.69 MB, 15.05 MB, 25.36 MB, 34.95 MB, 16.25 MB, 28.92 MB, 25.38 MB, 16.57 MB, 25.60 MB, 24.69 MB, 15.51 MB, 25.30 MB, 26.13 MB, 11.92 MB, 9.27 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.11 MB (49400018) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.05 GB (1131715457) - RowsProduced: 5.52M (5517802) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m55s - TotalStorageWaitTime: 1s390ms - TotalThreadsInvoluntaryContextSwitches: 1.20K (1201) - TotalThreadsTotalWallClockTime: 8m10s - TotalThreadsSysTime: 1s014ms - TotalThreadsUserTime: 5s377ms - TotalThreadsVoluntaryContextSwitches: 29.73K (29734) Fragment Instance Lifecycle Timings: - ExecTime: 4m11s - ExecTreeExecTime: 6s820ms - OpenTime: 250.972ms - ExecTreeOpenTime: 3.299ms - PrepareTime: 993.342ms - ExecTreePrepareTime: 294.214ms KrpcDataStreamSender (dst_id=18):(Total: 6s074ms, non-child: 6s074ms, % non-child: 100.00%) - BytesSent: 124.85 MB (130915138) - OverallThroughput: 20.55 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.52M (5517802) - RpcRetry: 0 (0) - SerializeBatchTime: 5s627ms - UncompressedRowBatchSize: 194.70 MB (204158674) CodeGen:(Total: 488.311ms, non-child: 488.311ms, % non-child: 100.00%) - CodegenTime: 3.163ms - CompileTime: 78.954ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 163.849ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 215.123ms HDFS_SCAN_NODE (id=1):(Total: 7s394ms, non-child: 7s394ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:269/770.65 MB 2:251/656.75 MB 1:259/671.73 MB 6:247/613.44 MB 7:240/575.90 MB -1:36/88.03 MB 0:247/642.04 MB 4:270/719.22 MB 5:249/664.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 161 out of 161 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.58% 1:0.4184% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:161 PARQUET/Unknown(Skipped):1907 BytesRead(4s000ms): 3.05 MB, 11.06 MB, 16.30 MB, 18.09 MB, 20.72 MB, 25.29 MB, 30.19 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.21 MB, 30.78 MB, 30.78 MB, 33.52 MB, 39.31 MB, 43.63 MB, 48.72 MB, 55.97 MB, 61.89 MB, 65.33 MB, 75.45 MB, 85.86 MB, 96.40 MB, 109.22 MB, 125.67 MB - FooterProcessingTime: (Avg: 2.270ms ; Min: 309.163us ; Max: 105.690ms ; Number of samples: 161) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 131.11 MB (137478492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.02 MB (134239607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.02 MB (134239607) - CachedFileHandlesHitCount: 917 (917) - CachedFileHandlesMissCount: 28 (28) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s885ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 161 (161) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.09 MB (6381146) - PerReadThreadRawHdfsThroughput: 175.44 MB/sec - RemoteScanRanges: 84 (84) - RowBatchQueueGetWaitTime: 6s054ms - RowBatchQueuePutWaitTime: 2m52s - RowsRead: 5.52M (5517802) - RowsReturned: 5.52M (5517802) - RowsReturnedRate: 746.21 K/sec - ScanRangesComplete: 2.07K (2068) - ScannerThreadsInvoluntaryContextSwitches: 442 (442) - ScannerThreadsTotalWallClockTime: 3m59s - MaterializeTupleTime(*): 44s793ms - ScannerThreadsSysTime: 462.929ms - ScannerThreadsUserTime: 1s948ms - ScannerThreadsVoluntaryContextSwitches: 14.11K (14110) - TotalRawHdfsReadTime(*): 747.306ms - TotalReadThroughput: 556.90 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935174) - Rows rejected: 0 (0) - Rows total: 5.52M (5517802) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2068) - RowGroups processed: 4.05K (4049) - RowGroups rejected: 0 (0) - RowGroups total: 5.47K (5473) - Rows processed: 1.94M (1935174) - Rows rejected: 0 (0) - Rows total: 5.52M (5517802) - Splits processed: 2.03K (2027) - Splits rejected: 1.91K (1907) - Splits total: 2.07K (2068) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935174) - Rows rejected: 0 (0) - Rows total: 5.52M (5517802) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935174) - Rows rejected: 0 (0) - Rows total: 5.52M (5517802) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1935174) - Rows rejected: 0 (0) - Rows total: 5.52M (5517802) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000031 (host=vc1538.foo.com:22000):(Total: 4m12s, non-child: 3m59s, % non-child: 95.01%) Hdfs split stats (:<# splits>/): 6:236/604.39 MB 2:260/678.70 MB 4:274/728.39 MB 7:227/564.27 MB 5:269/753.11 MB 1:264/734.93 MB 3:246/616.80 MB -1:34/85.68 MB 0:249/636.48 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m4s Filter 14 arrival: 3m3s Filter 12 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 12.43 MB, 25.67 MB, 41.23 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.11 MB, 47.12 MB, 47.23 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 47.25 MB, 44.84 MB, 23.81 MB, 15.38 MB, 25.03 MB, 30.98 MB, 12.86 MB, 23.26 MB, 25.35 MB, 24.14 MB, 25.04 MB, 24.84 MB, 22.54 MB, 25.68 MB, 13.36 MB, 13.43 MB, 9.58 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.25 MB (49541188) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.06 GB (1140227388) - RowsProduced: 5.55M (5545648) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m11s - TotalStorageWaitTime: 818.246ms - TotalThreadsInvoluntaryContextSwitches: 1.41K (1408) - TotalThreadsTotalWallClockTime: 8m7s - TotalThreadsSysTime: 1s036ms - TotalThreadsUserTime: 5s253ms - TotalThreadsVoluntaryContextSwitches: 27.07K (27071) Fragment Instance Lifecycle Timings: - ExecTime: 4m11s - ExecTreeExecTime: 8s558ms - OpenTime: 230.127ms - ExecTreeOpenTime: 3.608ms - PrepareTime: 458.874ms - ExecTreePrepareTime: 66.332ms KrpcDataStreamSender (dst_id=18):(Total: 3s473ms, non-child: 3s473ms, % non-child: 100.00%) - BytesSent: 125.52 MB (131615171) - OverallThroughput: 36.13 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.55M (5545648) - RpcRetry: 0 (0) - SerializeBatchTime: 3s318ms - UncompressedRowBatchSize: 195.68 MB (205188976) CodeGen:(Total: 432.243ms, non-child: 432.243ms, % non-child: 100.00%) - CodegenTime: 4.300ms - CompileTime: 71.041ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 147.735ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 197.242ms HDFS_SCAN_NODE (id=1):(Total: 8s680ms, non-child: 8s680ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:236/604.39 MB 2:260/678.70 MB 4:274/728.39 MB 7:227/564.27 MB 5:269/753.11 MB 1:264/734.93 MB 3:246/616.80 MB -1:34/85.68 MB 0:249/636.48 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 167 out of 167 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 401ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2119% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:167 PARQUET/Unknown(Skipped):1892 BytesRead(4s000ms): 3.65 MB, 13.08 MB, 28.78 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 30.93 MB, 31.44 MB, 31.47 MB, 34.24 MB, 40.08 MB, 44.93 MB, 48.07 MB, 54.08 MB, 62.49 MB, 69.76 MB, 77.36 MB, 90.00 MB, 103.91 MB, 117.88 MB - FooterProcessingTime: (Avg: 1.654ms ; Min: 331.468us ; Max: 25.508ms ; Number of samples: 167) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 132.78 MB (139224888) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.50 MB (133688852) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.50 MB (133688852) - CachedFileHandlesHitCount: 936 (936) - CachedFileHandlesMissCount: 37 (37) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s535ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 167 (167) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.03 MB (6324996) - PerReadThreadRawHdfsThroughput: 172.38 MB/sec - RemoteScanRanges: 108 (108) - RowBatchQueueGetWaitTime: 7s503ms - RowBatchQueuePutWaitTime: 3m2s - RowsRead: 5.55M (5545648) - RowsReturned: 5.55M (5545648) - RowsReturnedRate: 638.88 K/sec - ScanRangesComplete: 2.06K (2059) - ScannerThreadsInvoluntaryContextSwitches: 517 (517) - ScannerThreadsTotalWallClockTime: 3m56s - MaterializeTupleTime(*): 35s302ms - ScannerThreadsSysTime: 490.925ms - ScannerThreadsUserTime: 1s927ms - ScannerThreadsVoluntaryContextSwitches: 12.94K (12936) - TotalRawHdfsReadTime(*): 770.239ms - TotalReadThroughput: 573.68 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1983142) - Rows rejected: 0 (0) - Rows total: 5.55M (5545648) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2059) - RowGroups processed: 4.08K (4075) - RowGroups rejected: 1 (1) - RowGroups total: 5.50K (5501) - Rows processed: 1.98M (1983142) - Rows rejected: 0 (0) - Rows total: 5.55M (5545648) - Splits processed: 2.02K (2015) - Splits rejected: 1.89K (1892) - Splits total: 2.06K (2059) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1983142) - Rows rejected: 0 (0) - Rows total: 5.55M (5545648) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1983142) - Rows rejected: 0 (0) - Rows total: 5.55M (5545648) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1983142) - Rows rejected: 0 (0) - Rows total: 5.55M (5545648) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003e (host=vc1516.foo.com:22000):(Total: 4m7s, non-child: 3m57s, % non-child: 95.84%) Hdfs split stats (:<# splits>/): 4:240/731.41 MB 7:246/652.52 MB -1:31/83.92 MB 0:239/575.43 MB 6:270/729.14 MB 2:247/616.82 MB 3:243/659.93 MB 1:245/648.12 MB 5:272/705.63 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 17.05 MB, 36.73 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.77 MB, 47.84 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.90 MB, 47.78 MB, 25.65 MB, 23.26 MB, 23.35 MB, 24.74 MB, 25.83 MB, 27.26 MB, 22.56 MB, 28.18 MB, 21.78 MB, 21.69 MB, 13.47 MB, 10.72 MB, 9.61 MB, 7.43 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.90 MB (50231118) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1112486005) - RowsProduced: 5.58M (5578812) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m18s - TotalStorageWaitTime: 1s395ms - TotalThreadsInvoluntaryContextSwitches: 1.41K (1407) - TotalThreadsTotalWallClockTime: 7m55s - TotalThreadsSysTime: 991.850ms - TotalThreadsUserTime: 5s172ms - TotalThreadsVoluntaryContextSwitches: 24.93K (24926) Fragment Instance Lifecycle Timings: - ExecTime: 4m6s - ExecTreeExecTime: 6s496ms - OpenTime: 294.056ms - ExecTreeOpenTime: 4.077ms - PrepareTime: 456.070ms - ExecTreePrepareTime: 57.301ms KrpcDataStreamSender (dst_id=18):(Total: 3s241ms, non-child: 3s241ms, % non-child: 100.00%) - BytesSent: 126.26 MB (132392192) - OverallThroughput: 38.95 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.58M (5578812) - RpcRetry: 0 (0) - SerializeBatchTime: 3s016ms - UncompressedRowBatchSize: 196.85 MB (206416044) CodeGen:(Total: 459.334ms, non-child: 459.334ms, % non-child: 100.00%) - CodegenTime: 1.964ms - CompileTime: 69.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 208.495ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 177.528ms HDFS_SCAN_NODE (id=1):(Total: 6s600ms, non-child: 6s600ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:240/731.41 MB 7:246/652.52 MB -1:31/83.92 MB 0:239/575.43 MB 6:270/729.14 MB 2:247/616.82 MB 3:243/659.93 MB 1:245/648.12 MB 5:272/705.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 160 out of 160 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 341ms Hdfs Read Thread Concurrency Bucket: 0:99.56% 1:0.4396% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:160 PARQUET/Unknown(Skipped):1873 BytesRead(4s000ms): 5.55 MB, 26.15 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.99 MB, 38.67 MB, 47.98 MB, 54.34 MB, 60.88 MB, 71.32 MB, 84.06 MB, 89.41 MB, 102.52 MB, 121.47 MB - FooterProcessingTime: (Avg: 3.206ms ; Min: 337.221us ; Max: 163.217ms ; Number of samples: 160) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 129.48 MB (135771713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.55 MB (130604422) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.55 MB (130604422) - CachedFileHandlesHitCount: 887 (887) - CachedFileHandlesMissCount: 25 (25) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s924ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 160 (160) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.50 MB (6815287) - PerReadThreadRawHdfsThroughput: 149.75 MB/sec - RemoteScanRanges: 75 (75) - RowBatchQueueGetWaitTime: 5s578ms - RowBatchQueuePutWaitTime: 3m6s - RowsRead: 5.58M (5578812) - RowsReturned: 5.58M (5578812) - RowsReturnedRate: 845.18 K/sec - ScanRangesComplete: 2.03K (2033) - ScannerThreadsInvoluntaryContextSwitches: 503 (503) - ScannerThreadsTotalWallClockTime: 3m48s - MaterializeTupleTime(*): 26s996ms - ScannerThreadsSysTime: 479.927ms - ScannerThreadsUserTime: 1s857ms - ScannerThreadsVoluntaryContextSwitches: 11.61K (11610) - TotalRawHdfsReadTime(*): 864.643ms - TotalReadThroughput: 580.26 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1970999) - Rows rejected: 0 (0) - Rows total: 5.58M (5578812) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.03K (2033) - RowGroups processed: 4.10K (4097) - RowGroups rejected: 1 (1) - RowGroups total: 5.53K (5527) - Rows processed: 1.97M (1970999) - Rows rejected: 0 (0) - Rows total: 5.58M (5578812) - Splits processed: 2.00K (1995) - Splits rejected: 1.87K (1873) - Splits total: 2.03K (2033) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1970999) - Rows rejected: 0 (0) - Rows total: 5.58M (5578812) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1970999) - Rows rejected: 0 (0) - Rows total: 5.58M (5578812) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1970999) - Rows rejected: 0 (0) - Rows total: 5.58M (5578812) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000038 (host=vc1535.foo.com:22000):(Total: 4m6s, non-child: 3m55s, % non-child: 95.39%) Hdfs split stats (:<# splits>/): 2:244/627.22 MB 5:249/627.64 MB 6:249/638.45 MB 3:269/698.51 MB 7:245/641.60 MB 1:243/708.92 MB -1:32/84.62 MB 0:262/690.88 MB 4:266/685.72 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m4s Filter 12 arrival: 3m3s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 20.04 MB, 18.96 MB, 29.44 MB, 77.18 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.71 MB, 78.74 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 78.85 MB, 74.03 MB, 20.33 MB, 24.27 MB, 28.44 MB, 19.55 MB, 26.46 MB, 16.88 MB, 23.32 MB, 23.78 MB, 23.66 MB, 22.57 MB, 25.66 MB, 7.08 MB, 6.81 MB, 6.45 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 78.85 MB (82677683) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1106891155) - RowsProduced: 5.40M (5397714) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m9s - TotalStorageWaitTime: 1s516ms - TotalThreadsInvoluntaryContextSwitches: 1.34K (1338) - TotalThreadsTotalWallClockTime: 7m56s - TotalThreadsSysTime: 963.853ms - TotalThreadsUserTime: 5s055ms - TotalThreadsVoluntaryContextSwitches: 26.09K (26091) Fragment Instance Lifecycle Timings: - ExecTime: 4m5s - ExecTreeExecTime: 7s592ms - OpenTime: 304.003ms - ExecTreeOpenTime: 3.434ms - PrepareTime: 428.830ms - ExecTreePrepareTime: 60.811ms KrpcDataStreamSender (dst_id=18):(Total: 3s213ms, non-child: 3s213ms, % non-child: 100.00%) - BytesSent: 121.29 MB (127181125) - OverallThroughput: 37.74 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.40M (5397714) - RpcRetry: 0 (0) - SerializeBatchTime: 2s989ms - UncompressedRowBatchSize: 190.46 MB (199715418) CodeGen:(Total: 435.170ms, non-child: 435.170ms, % non-child: 100.00%) - CodegenTime: 2.411ms - CompileTime: 131.203ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 155.915ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 139.004ms HDFS_SCAN_NODE (id=1):(Total: 7s702ms, non-child: 7s702ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:244/627.22 MB 5:249/627.64 MB 6:249/638.45 MB 3:269/698.51 MB 7:245/641.60 MB 1:243/708.92 MB -1:32/84.62 MB 0:262/690.88 MB 4:266/685.72 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 150 out of 150 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 361ms Hdfs Read Thread Concurrency Bucket: 0:99.57% 1:0.4329% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:150 PARQUET/Unknown(Skipped):1909 BytesRead(4s000ms): 6.38 MB, 17.74 MB, 28.47 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.87 MB, 49.96 MB, 52.56 MB, 57.84 MB, 63.39 MB, 73.10 MB, 84.01 MB, 87.99 MB, 98.13 MB, 108.70 MB, 115.89 MB, 132.88 MB - FooterProcessingTime: (Avg: 3.281ms ; Min: 271.448us ; Max: 111.301ms ; Number of samples: 150) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 151.33 MB (158685193) - BytesReadDataNodeCache: 0 - BytesReadLocal: 146.56 MB (153684478) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 146.56 MB (153684478) - CachedFileHandlesHitCount: 887 (887) - CachedFileHandlesMissCount: 34 (34) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s091ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 150 (150) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 36.72 MB (38501884) - PerReadThreadRawHdfsThroughput: 150.33 MB/sec - RemoteScanRanges: 102 (102) - RowBatchQueueGetWaitTime: 6s614ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 5.40M (5397714) - RowsReturned: 5.40M (5397714) - RowsReturnedRate: 700.76 K/sec - ScanRangesComplete: 2.06K (2059) - ScannerThreadsInvoluntaryContextSwitches: 528 (528) - ScannerThreadsTotalWallClockTime: 3m50s - MaterializeTupleTime(*): 35s261ms - ScannerThreadsSysTime: 485.926ms - ScannerThreadsUserTime: 1s816ms - ScannerThreadsVoluntaryContextSwitches: 12.30K (12300) - TotalRawHdfsReadTime(*): 1s006ms - TotalReadThroughput: 669.40 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933237) - Rows rejected: 0 (0) - Rows total: 5.40M (5397714) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2059) - RowGroups processed: 3.91K (3913) - RowGroups rejected: 1 (1) - RowGroups total: 5.34K (5343) - Rows processed: 1.93M (1933237) - Rows rejected: 0 (0) - Rows total: 5.40M (5397714) - Splits processed: 2.03K (2028) - Splits rejected: 1.91K (1909) - Splits total: 2.06K (2059) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933237) - Rows rejected: 0 (0) - Rows total: 5.40M (5397714) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933237) - Rows rejected: 0 (0) - Rows total: 5.40M (5397714) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1933237) - Rows rejected: 0 (0) - Rows total: 5.40M (5397714) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002a (host=vc1539.foo.com:22000):(Total: 4m6s, non-child: 3m56s, % non-child: 96.07%) Hdfs split stats (:<# splits>/): 3:250/672.88 MB 6:251/772.44 MB 4:243/600.54 MB 1:248/650.83 MB 7:241/632.09 MB 5:262/688.96 MB -1:33/88.64 MB 0:248/630.09 MB 2:272/667.22 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m3s Filter 14 arrival: 3m2s Filter 13 arrival: 3m2s Filter 12 arrival: 3m2s MemoryUsage(4s000ms): 15.13 MB, 33.38 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.71 MB, 88.75 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 88.85 MB, 68.00 MB, 14.24 MB, 21.43 MB, 20.39 MB, 33.25 MB, 17.54 MB, 26.09 MB, 21.90 MB, 15.91 MB, 23.66 MB, 23.14 MB, 22.51 MB, 14.40 MB, 11.70 MB, 11.58 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 88.85 MB (93163377) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.06 GB (1141810721) - RowsProduced: 5.60M (5598817) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m9s - TotalStorageWaitTime: 1s126ms - TotalThreadsInvoluntaryContextSwitches: 1.58K (1584) - TotalThreadsTotalWallClockTime: 7m58s - TotalThreadsSysTime: 960.854ms - TotalThreadsUserTime: 5s282ms - TotalThreadsVoluntaryContextSwitches: 26.27K (26270) Fragment Instance Lifecycle Timings: - ExecTime: 4m4s - ExecTreeExecTime: 4s941ms - OpenTime: 208.565ms - ExecTreeOpenTime: 3.121ms - PrepareTime: 1s241ms - ExecTreePrepareTime: 285.101ms KrpcDataStreamSender (dst_id=18):(Total: 3s851ms, non-child: 3s851ms, % non-child: 100.00%) - BytesSent: 126.16 MB (132293513) - OverallThroughput: 32.76 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.60M (5598817) - RpcRetry: 0 (0) - SerializeBatchTime: 3s069ms - UncompressedRowBatchSize: 197.56 MB (207156229) CodeGen:(Total: 332.105ms, non-child: 332.105ms, % non-child: 100.00%) - CodegenTime: 4.086ms - CompileTime: 96.532ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 102.984ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 112.943ms HDFS_SCAN_NODE (id=1):(Total: 5s498ms, non-child: 5s498ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:250/672.88 MB 6:251/772.44 MB 4:243/600.54 MB 1:248/650.83 MB 7:241/632.09 MB 5:262/688.96 MB -1:33/88.64 MB 0:248/630.09 MB 2:272/667.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 158 out of 158 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:99.79% 1:0.2146% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:158 PARQUET/Unknown(Skipped):1890 BytesRead(4s000ms): 5.69 MB, 30.73 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 60.86 MB, 61.17 MB, 61.97 MB, 67.99 MB, 80.00 MB, 91.53 MB, 96.65 MB, 106.44 MB, 121.65 MB, 131.35 MB, 135.75 MB, 145.34 MB, 158.67 MB - FooterProcessingTime: (Avg: 1.846ms ; Min: 370.137us ; Max: 35.509ms ; Number of samples: 158) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 163.78 MB (171738834) - BytesReadDataNodeCache: 0 - BytesReadLocal: 159.63 MB (167379952) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 159.63 MB (167379952) - CachedFileHandlesHitCount: 905 (905) - CachedFileHandlesMissCount: 28 (28) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s636ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 158 (158) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 46.72 MB (48987578) - PerReadThreadRawHdfsThroughput: 181.31 MB/sec - RemoteScanRanges: 84 (84) - RowBatchQueueGetWaitTime: 4s211ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 5.60M (5598817) - RowsReturned: 5.60M (5598817) - RowsReturnedRate: 1.02 M/sec - ScanRangesComplete: 2.05K (2048) - ScannerThreadsInvoluntaryContextSwitches: 657 (657) - ScannerThreadsTotalWallClockTime: 3m53s - MaterializeTupleTime(*): 36s148ms - ScannerThreadsSysTime: 476.927ms - ScannerThreadsUserTime: 1s870ms - ScannerThreadsVoluntaryContextSwitches: 12.36K (12356) - TotalRawHdfsReadTime(*): 903.335ms - TotalReadThroughput: 715.19 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017355) - Rows rejected: 0 (0) - Rows total: 5.60M (5598817) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2048) - RowGroups processed: 4.11K (4108) - RowGroups rejected: 1 (1) - RowGroups total: 5.54K (5541) - Rows processed: 2.02M (2017355) - Rows rejected: 0 (0) - Rows total: 5.60M (5598817) - Splits processed: 2.01K (2014) - Splits rejected: 1.89K (1890) - Splits total: 2.05K (2048) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017355) - Rows rejected: 0 (0) - Rows total: 5.60M (5598817) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017355) - Rows rejected: 0 (0) - Rows total: 5.60M (5598817) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2017355) - Rows rejected: 0 (0) - Rows total: 5.60M (5598817) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000030 (host=vc1523.foo.com:22000):(Total: 4m5s, non-child: 3m50s, % non-child: 94.03%) Hdfs split stats (:<# splits>/): 2:269/692.95 MB 1:268/718.92 MB 7:256/657.67 MB 3:258/665.97 MB 4:259/653.52 MB 6:226/594.72 MB 5:235/584.96 MB -1:32/82.62 MB 0:286/751.22 MB Filter 10 arrival: 1m Filter 8 arrival: 1m1s Filter 12 arrival: 3m1s Filter 14 arrival: 3m1s Filter 13 arrival: 3m2s MemoryUsage(4s000ms): 6.55 MB, 23.77 MB, 25.53 MB, 17.59 MB, 36.01 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.18 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 48.21 MB, 47.96 MB, 37.25 MB, 16.61 MB, 25.22 MB, 26.91 MB, 20.82 MB, 24.43 MB, 21.78 MB, 25.02 MB, 19.33 MB, 25.65 MB, 21.15 MB, 25.40 MB, 16.16 MB, 15.16 MB, 8.41 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.21 MB (50555935) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1117638012) - RowsProduced: 5.64M (5637020) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m52s - TotalStorageWaitTime: 1s287ms - TotalThreadsInvoluntaryContextSwitches: 1.27K (1272) - TotalThreadsTotalWallClockTime: 7m57s - TotalThreadsSysTime: 1s032ms - TotalThreadsUserTime: 5s433ms - TotalThreadsVoluntaryContextSwitches: 28.73K (28732) Fragment Instance Lifecycle Timings: - ExecTime: 4m3s - ExecTreeExecTime: 9s074ms - OpenTime: 447.778ms - ExecTreeOpenTime: 3.165ms - PrepareTime: 1s607ms - ExecTreePrepareTime: 716.105ms KrpcDataStreamSender (dst_id=18):(Total: 3s451ms, non-child: 3s451ms, % non-child: 100.00%) - BytesSent: 127.71 MB (133915893) - OverallThroughput: 37.00 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.64M (5637020) - RpcRetry: 0 (0) - SerializeBatchTime: 2s854ms - UncompressedRowBatchSize: 198.91 MB (208569740) CodeGen:(Total: 717.479ms, non-child: 717.479ms, % non-child: 100.00%) - CodegenTime: 3.693ms - CompileTime: 118.610ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 298.929ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 272.590ms HDFS_SCAN_NODE (id=1):(Total: 10s492ms, non-child: 10s492ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:269/692.95 MB 1:268/718.92 MB 7:256/657.67 MB 3:258/665.97 MB 4:259/653.52 MB 6:226/594.72 MB 5:235/584.96 MB -1:32/82.62 MB 0:286/751.22 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:165 PARQUET/Unknown(Skipped):1924 BytesRead(4s000ms): 1.43 MB, 9.45 MB, 16.05 MB, 20.35 MB, 27.73 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 31.41 MB, 32.12 MB, 34.92 MB, 39.96 MB, 46.97 MB, 54.60 MB, 63.88 MB, 69.95 MB, 76.60 MB, 85.19 MB, 95.92 MB, 103.01 MB, 120.55 MB, 132.31 MB - FooterProcessingTime: (Avg: 4.170ms ; Min: 358.936us ; Max: 319.775ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 133.31 MB (139785003) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.66 MB (134913570) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.66 MB (134913570) - CachedFileHandlesHitCount: 920 (920) - CachedFileHandlesMissCount: 30 (30) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s188ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6447347) - PerReadThreadRawHdfsThroughput: 141.04 MB/sec - RemoteScanRanges: 90 (90) - RowBatchQueueGetWaitTime: 8s003ms - RowBatchQueuePutWaitTime: 2m51s - RowsRead: 5.64M (5637020) - RowsReturned: 5.64M (5637020) - RowsReturnedRate: 537.26 K/sec - ScanRangesComplete: 2.09K (2089) - ScannerThreadsInvoluntaryContextSwitches: 466 (466) - ScannerThreadsTotalWallClockTime: 3m53s - MaterializeTupleTime(*): 40s642ms - ScannerThreadsSysTime: 507.922ms - ScannerThreadsUserTime: 1s980ms - ScannerThreadsVoluntaryContextSwitches: 13.72K (13718) - TotalRawHdfsReadTime(*): 945.157ms - TotalReadThroughput: 572.36 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1985366) - Rows rejected: 0 (0) - Rows total: 5.64M (5637020) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.09K (2089) - RowGroups processed: 4.16K (4157) - RowGroups rejected: 1 (1) - RowGroups total: 5.58K (5585) - Rows processed: 1.99M (1985366) - Rows rejected: 0 (0) - Rows total: 5.64M (5637020) - Splits processed: 2.05K (2047) - Splits rejected: 1.92K (1924) - Splits total: 2.09K (2089) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1985366) - Rows rejected: 0 (0) - Rows total: 5.64M (5637020) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1985366) - Rows rejected: 0 (0) - Rows total: 5.64M (5637020) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1985366) - Rows rejected: 0 (0) - Rows total: 5.64M (5637020) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000047 (host=vc1526.foo.com:22000):(Total: 4m1s, non-child: 3m53s, % non-child: 96.60%) Hdfs split stats (:<# splits>/): 1:239/696.64 MB 2:237/613.45 MB -1:34/82.98 MB 0:244/632.50 MB 7:272/678.45 MB 4:264/687.69 MB 6:276/730.95 MB 5:238/655.20 MB 3:244/624.02 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m3s Filter 14 arrival: 3m3s Filter 12 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 9.71 MB, 24.72 MB, 24.10 MB, 46.38 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.31 MB, 46.34 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.44 MB, 46.12 MB, 19.85 MB, 21.51 MB, 21.62 MB, 22.07 MB, 16.97 MB, 24.35 MB, 22.95 MB, 29.66 MB, 21.47 MB, 21.43 MB, 12.93 MB, 10.76 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.42 MB (49726927) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1117214753) - RowsProduced: 5.67M (5668580) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m9s - TotalStorageWaitTime: 1s226ms - TotalThreadsInvoluntaryContextSwitches: 1.50K (1497) - TotalThreadsTotalWallClockTime: 7m46s - TotalThreadsSysTime: 976.850ms - TotalThreadsUserTime: 5s300ms - TotalThreadsVoluntaryContextSwitches: 26.08K (26076) Fragment Instance Lifecycle Timings: - ExecTime: 4m - ExecTreeExecTime: 5s389ms - OpenTime: 201.502ms - ExecTreeOpenTime: 2.597ms - PrepareTime: 347.699ms - ExecTreePrepareTime: 50.857ms KrpcDataStreamSender (dst_id=18):(Total: 2s373ms, non-child: 2s373ms, % non-child: 100.00%) - BytesSent: 128.38 MB (134621194) - OverallThroughput: 54.08 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.67M (5668580) - RpcRetry: 0 (0) - SerializeBatchTime: 2s238ms - UncompressedRowBatchSize: 200.02 MB (209737460) CodeGen:(Total: 355.516ms, non-child: 355.516ms, % non-child: 100.00%) - CodegenTime: 3.268ms - CompileTime: 50.259ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 145.822ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 152.129ms HDFS_SCAN_NODE (id=1):(Total: 5s478ms, non-child: 5s478ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:239/696.64 MB 2:237/613.45 MB -1:34/82.98 MB 0:244/632.50 MB 7:272/678.45 MB 4:264/687.69 MB 6:276/730.95 MB 5:238/655.20 MB 3:244/624.02 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 542ms Hdfs Read Thread Concurrency Bucket: 0:99.78% 1:0.2222% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:168 PARQUET/Unknown(Skipped):1880 BytesRead(4s000ms): 2.46 MB, 9.22 MB, 23.26 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 30.45 MB, 31.15 MB, 32.79 MB, 37.33 MB, 47.02 MB, 59.67 MB, 67.19 MB, 75.51 MB, 94.78 MB, 106.95 MB, 115.84 MB - FooterProcessingTime: (Avg: 2.774ms ; Min: 282.466us ; Max: 109.120ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 133.27 MB (139748813) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.55 MB (132694465) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.55 MB (132694465) - CachedFileHandlesHitCount: 918 (918) - CachedFileHandlesMissCount: 41 (41) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s937ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.27 MB (6572084) - PerReadThreadRawHdfsThroughput: 157.60 MB/sec - RemoteScanRanges: 123 (123) - RowBatchQueueGetWaitTime: 4s344ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 5.67M (5668580) - RowsReturned: 5.67M (5668580) - RowsReturnedRate: 1.03 M/sec - ScanRangesComplete: 2.05K (2048) - ScannerThreadsInvoluntaryContextSwitches: 555 (555) - ScannerThreadsTotalWallClockTime: 3m46s - MaterializeTupleTime(*): 32s120ms - ScannerThreadsSysTime: 481.926ms - ScannerThreadsUserTime: 1s910ms - ScannerThreadsVoluntaryContextSwitches: 12.33K (12332) - TotalRawHdfsReadTime(*): 845.668ms - TotalReadThroughput: 594.51 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2042030) - Rows rejected: 0 (0) - Rows total: 5.67M (5668580) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2048) - RowGroups processed: 4.20K (4197) - RowGroups rejected: 0 (0) - RowGroups total: 5.62K (5619) - Rows processed: 2.04M (2042030) - Rows rejected: 0 (0) - Rows total: 5.67M (5668580) - Splits processed: 2.01K (2007) - Splits rejected: 1.88K (1880) - Splits total: 2.05K (2048) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2042030) - Rows rejected: 0 (0) - Rows total: 5.67M (5668580) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2042030) - Rows rejected: 0 (0) - Rows total: 5.67M (5668580) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2042030) - Rows rejected: 0 (0) - Rows total: 5.67M (5668580) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002c (host=vc1525.foo.com:22000):(Total: 4m, non-child: 3m50s, % non-child: 95.72%) Hdfs split stats (:<# splits>/): 2:244/629.27 MB 3:255/639.78 MB 5:266/699.80 MB 1:264/665.77 MB 7:252/650.06 MB 4:249/748.00 MB 6:262/666.09 MB -1:32/86.64 MB 0:242/617.20 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m3s Filter 14 arrival: 3m3s Filter 12 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 12.05 MB, 28.35 MB, 24.97 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.22 MB, 47.25 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 46.22 MB, 21.17 MB, 26.19 MB, 19.58 MB, 27.77 MB, 24.84 MB, 21.37 MB, 19.21 MB, 25.41 MB, 23.98 MB, 17.77 MB, 13.68 MB, 10.14 MB, 7.60 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.35 MB (49652638) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1113875054) - RowsProduced: 5.69M (5692592) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m12s - TotalStorageWaitTime: 829.293ms - TotalThreadsInvoluntaryContextSwitches: 1.69K (1685) - TotalThreadsTotalWallClockTime: 7m43s - TotalThreadsSysTime: 995.848ms - TotalThreadsUserTime: 5s352ms - TotalThreadsVoluntaryContextSwitches: 25.17K (25172) Fragment Instance Lifecycle Timings: - ExecTime: 4m - ExecTreeExecTime: 6s941ms - OpenTime: 273.872ms - ExecTreeOpenTime: 2.837ms - PrepareTime: 354.823ms - ExecTreePrepareTime: 43.894ms KrpcDataStreamSender (dst_id=18):(Total: 2s848ms, non-child: 2s848ms, % non-child: 100.00%) - BytesSent: 128.95 MB (135209505) - OverallThroughput: 45.27 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.69M (5692592) - RpcRetry: 0 (0) - SerializeBatchTime: 2s705ms - UncompressedRowBatchSize: 200.87 MB (210625904) CodeGen:(Total: 434.172ms, non-child: 434.172ms, % non-child: 100.00%) - CodegenTime: 2.749ms - CompileTime: 109.276ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 151.841ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 159.394ms HDFS_SCAN_NODE (id=1):(Total: 7s017ms, non-child: 7s017ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:244/629.27 MB 3:255/639.78 MB 5:266/699.80 MB 1:264/665.77 MB 7:252/650.06 MB 4:249/748.00 MB 6:262/666.09 MB -1:32/86.64 MB 0:242/617.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 462ms Hdfs Read Thread Concurrency Bucket: 0:99.78% 1:0.2247% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:168 PARQUET/Unknown(Skipped):1898 BytesRead(4s000ms): 3.41 MB, 13.28 MB, 23.16 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 30.79 MB, 32.88 MB, 42.32 MB, 54.39 MB, 61.92 MB, 75.30 MB, 91.69 MB, 102.96 MB, 110.70 MB - FooterProcessingTime: (Avg: 1.697ms ; Min: 243.696us ; Max: 33.211ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 136.04 MB (142647510) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.66 MB (137009797) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.66 MB (137009797) - CachedFileHandlesHitCount: 948 (948) - CachedFileHandlesMissCount: 38 (38) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s716ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.40 MB (6714875) - PerReadThreadRawHdfsThroughput: 163.81 MB/sec - RemoteScanRanges: 114 (114) - RowBatchQueueGetWaitTime: 6s106ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 5.69M (5692592) - RowsReturned: 5.69M (5692592) - RowsReturnedRate: 811.18 K/sec - ScanRangesComplete: 2.07K (2066) - ScannerThreadsInvoluntaryContextSwitches: 703 (703) - ScannerThreadsTotalWallClockTime: 3m42s - MaterializeTupleTime(*): 28s509ms - ScannerThreadsSysTime: 493.924ms - ScannerThreadsUserTime: 1s926ms - ScannerThreadsVoluntaryContextSwitches: 11.91K (11910) - TotalRawHdfsReadTime(*): 830.478ms - TotalReadThroughput: 624.68 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2037842) - Rows rejected: 0 (0) - Rows total: 5.69M (5692592) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2066) - RowGroups processed: 4.22K (4222) - RowGroups rejected: 1 (1) - RowGroups total: 5.65K (5649) - Rows processed: 2.04M (2037842) - Rows rejected: 0 (0) - Rows total: 5.69M (5692592) - Splits processed: 2.02K (2025) - Splits rejected: 1.90K (1898) - Splits total: 2.07K (2066) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2037842) - Rows rejected: 0 (0) - Rows total: 5.69M (5692592) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2037842) - Rows rejected: 0 (0) - Rows total: 5.69M (5692592) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.04M (2037842) - Rows rejected: 0 (0) - Rows total: 5.69M (5692592) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000039 (host=vc1540.foo.com:22000):(Total: 3m59s, non-child: 3m50s, % non-child: 96.38%) Hdfs split stats (:<# splits>/): 5:252/650.24 MB 7:256/658.08 MB -1:35/88.91 MB 0:254/640.64 MB 2:245/721.60 MB 3:250/643.26 MB 1:249/682.81 MB 6:252/628.92 MB 4:272/689.83 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m4s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s Filter 12 arrival: 3m3s MemoryUsage(4s000ms): 17.80 MB, 25.73 MB, 47.44 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.58 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 46.67 MB, 19.56 MB, 25.53 MB, 23.87 MB, 23.01 MB, 21.63 MB, 25.69 MB, 27.70 MB, 24.86 MB, 16.27 MB, 16.15 MB, 9.84 MB, 8.36 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.71 MB (50023794) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1108190946) - RowsProduced: 5.65M (5649822) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m16s - TotalStorageWaitTime: 1s211ms - TotalThreadsInvoluntaryContextSwitches: 1.54K (1541) - TotalThreadsTotalWallClockTime: 7m39s - TotalThreadsSysTime: 952.855ms - TotalThreadsUserTime: 5s285ms - TotalThreadsVoluntaryContextSwitches: 24.81K (24812) Fragment Instance Lifecycle Timings: - ExecTime: 3m58s - ExecTreeExecTime: 5s749ms - OpenTime: 190.629ms - ExecTreeOpenTime: 3.252ms - PrepareTime: 311.126ms - ExecTreePrepareTime: 83.281ms KrpcDataStreamSender (dst_id=18):(Total: 2s447ms, non-child: 2s447ms, % non-child: 100.00%) - BytesSent: 127.90 MB (134111463) - OverallThroughput: 52.26 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.65M (5649822) - RpcRetry: 0 (0) - SerializeBatchTime: 2s342ms - UncompressedRowBatchSize: 199.36 MB (209043414) CodeGen:(Total: 302.919ms, non-child: 302.919ms, % non-child: 100.00%) - CodegenTime: 8.795ms - CompileTime: 35.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 140.158ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 125.521ms HDFS_SCAN_NODE (id=1):(Total: 5s903ms, non-child: 5s903ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:252/650.24 MB 7:256/658.08 MB -1:35/88.91 MB 0:254/640.64 MB 2:245/721.60 MB 3:250/643.26 MB 1:249/682.81 MB 6:252/628.92 MB 4:272/689.83 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 162 out of 162 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 582ms Hdfs Read Thread Concurrency Bucket: 0:99.55% 1:0.4525% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:162 PARQUET/Unknown(Skipped):1903 BytesRead(4s000ms): 5.50 MB, 17.47 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 30.02 MB, 32.68 MB, 42.43 MB, 54.68 MB, 65.10 MB, 78.40 MB, 96.97 MB, 106.81 MB, 117.86 MB - FooterProcessingTime: (Avg: 2.911ms ; Min: 313.739us ; Max: 110.525ms ; Number of samples: 162) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 131.25 MB (137626729) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.91 MB (130975869) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.91 MB (130975869) - CachedFileHandlesHitCount: 885 (885) - CachedFileHandlesMissCount: 39 (39) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s249ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 162 (162) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 5.83 MB (6113560) - PerReadThreadRawHdfsThroughput: 160.69 MB/sec - RemoteScanRanges: 117 (117) - RowBatchQueueGetWaitTime: 4s911ms - RowBatchQueuePutWaitTime: 3m2s - RowsRead: 5.65M (5649822) - RowsReturned: 5.65M (5649822) - RowsReturnedRate: 957.01 K/sec - ScanRangesComplete: 2.06K (2065) - ScannerThreadsInvoluntaryContextSwitches: 666 (666) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 26s774ms - ScannerThreadsSysTime: 477.927ms - ScannerThreadsUserTime: 1s899ms - ScannerThreadsVoluntaryContextSwitches: 11.71K (11710) - TotalRawHdfsReadTime(*): 816.806ms - TotalReadThroughput: 606.78 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006062) - Rows rejected: 0 (0) - Rows total: 5.65M (5649822) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2065) - RowGroups processed: 4.18K (4177) - RowGroups rejected: 1 (1) - RowGroups total: 5.61K (5605) - Rows processed: 2.01M (2006062) - Rows rejected: 0 (0) - Rows total: 5.65M (5649822) - Splits processed: 2.03K (2028) - Splits rejected: 1.90K (1903) - Splits total: 2.06K (2065) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006062) - Rows rejected: 0 (0) - Rows total: 5.65M (5649822) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006062) - Rows rejected: 0 (0) - Rows total: 5.65M (5649822) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006062) - Rows rejected: 0 (0) - Rows total: 5.65M (5649822) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000037 (host=vc1513.foo.com:22000):(Total: 3m58s, non-child: 3m48s, % non-child: 95.61%) Hdfs split stats (:<# splits>/): 2:249/667.11 MB 5:226/565.27 MB 6:261/662.70 MB 1:276/693.37 MB 4:257/671.12 MB 3:259/661.29 MB -1:34/89.16 MB 0:246/754.38 MB 7:255/640.15 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 17.45 MB, 28.96 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.00 MB, 48.07 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 48.14 MB, 39.89 MB, 19.62 MB, 24.55 MB, 23.40 MB, 22.74 MB, 22.77 MB, 26.88 MB, 23.01 MB, 24.29 MB, 26.23 MB, 12.96 MB, 9.52 MB, 7.95 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.14 MB (50476055) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1114757875) - RowsProduced: 5.55M (5548522) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m12s - TotalStorageWaitTime: 989.139ms - TotalThreadsInvoluntaryContextSwitches: 1.69K (1691) - TotalThreadsTotalWallClockTime: 7m42s - TotalThreadsSysTime: 965.852ms - TotalThreadsUserTime: 5s133ms - TotalThreadsVoluntaryContextSwitches: 24.97K (24971) Fragment Instance Lifecycle Timings: - ExecTime: 3m58s - ExecTreeExecTime: 7s209ms - OpenTime: 416.934ms - ExecTreeOpenTime: 4.096ms - PrepareTime: 315.956ms - ExecTreePrepareTime: 42.657ms KrpcDataStreamSender (dst_id=18):(Total: 2s668ms, non-child: 2s668ms, % non-child: 100.00%) - BytesSent: 125.57 MB (131673758) - OverallThroughput: 47.06 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.55M (5548522) - RpcRetry: 0 (0) - SerializeBatchTime: 2s526ms - UncompressedRowBatchSize: 195.78 MB (205295314) CodeGen:(Total: 532.278ms, non-child: 532.278ms, % non-child: 100.00%) - CodegenTime: 3.888ms - CompileTime: 84.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 281.597ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 157.491ms HDFS_SCAN_NODE (id=1):(Total: 7s284ms, non-child: 7s284ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:249/667.11 MB 5:226/565.27 MB 6:261/662.70 MB 1:276/693.37 MB 4:257/671.12 MB 3:259/661.29 MB -1:34/89.16 MB 0:246/754.38 MB 7:255/640.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 361ms Hdfs Read Thread Concurrency Bucket: 0:99.78% 1:0.2232% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:156 PARQUET/Unknown(Skipped):1907 BytesRead(4s000ms): 8.43 MB, 24.22 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 29.70 MB, 30.01 MB, 32.57 MB, 37.20 MB, 44.42 MB, 56.59 MB, 67.69 MB, 74.02 MB, 93.62 MB, 111.06 MB, 121.01 MB - FooterProcessingTime: (Avg: 2.446ms ; Min: 241.593us ; Max: 74.174ms ; Number of samples: 156) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 127.69 MB (133889230) - BytesReadDataNodeCache: 0 - BytesReadLocal: 123.05 MB (129029827) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 123.05 MB (129029827) - CachedFileHandlesHitCount: 852 (852) - CachedFileHandlesMissCount: 33 (33) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s123ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 156 (156) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.08 MB (6376861) - PerReadThreadRawHdfsThroughput: 166.76 MB/sec - RemoteScanRanges: 99 (99) - RowBatchQueueGetWaitTime: 6s423ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 5.55M (5548522) - RowsReturned: 5.55M (5548522) - RowsReturnedRate: 761.67 K/sec - ScanRangesComplete: 2.06K (2063) - ScannerThreadsInvoluntaryContextSwitches: 746 (746) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 27s677ms - ScannerThreadsSysTime: 455.930ms - ScannerThreadsUserTime: 1s855ms - ScannerThreadsVoluntaryContextSwitches: 11.82K (11823) - TotalRawHdfsReadTime(*): 765.683ms - TotalReadThroughput: 582.41 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1948203) - Rows rejected: 0 (0) - Rows total: 5.55M (5548522) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2063) - RowGroups processed: 4.07K (4071) - RowGroups rejected: 1 (1) - RowGroups total: 5.50K (5497) - Rows processed: 1.95M (1948203) - Rows rejected: 0 (0) - Rows total: 5.55M (5548522) - Splits processed: 2.03K (2027) - Splits rejected: 1.91K (1907) - Splits total: 2.06K (2063) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1948203) - Rows rejected: 0 (0) - Rows total: 5.55M (5548522) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1948203) - Rows rejected: 0 (0) - Rows total: 5.55M (5548522) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1948203) - Rows rejected: 0 (0) - Rows total: 5.55M (5548522) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002f (host=vc1541.foo.com:22000):(Total: 3m58s, non-child: 3m48s, % non-child: 95.95%) Hdfs split stats (:<# splits>/): 2:234/605.73 MB 1:296/788.17 MB 7:240/589.29 MB 5:240/638.02 MB -1:33/85.87 MB 0:241/686.67 MB 6:265/681.67 MB 4:255/673.09 MB 3:251/655.92 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m4s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s Filter 12 arrival: 3m3s MemoryUsage(4s000ms): 8.69 MB, 25.74 MB, 22.58 MB, 43.07 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.62 MB, 47.74 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 47.75 MB, 46.69 MB, 26.31 MB, 21.38 MB, 23.58 MB, 26.12 MB, 25.71 MB, 25.16 MB, 22.00 MB, 26.67 MB, 23.34 MB, 23.37 MB, 13.30 MB, 9.52 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.75 MB (50070934) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1099305038) - RowsProduced: 5.80M (5802847) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m6s - TotalStorageWaitTime: 1s416ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1591) - TotalThreadsTotalWallClockTime: 7m44s - TotalThreadsSysTime: 965.852ms - TotalThreadsUserTime: 5s286ms - TotalThreadsVoluntaryContextSwitches: 25.66K (25659) Fragment Instance Lifecycle Timings: - ExecTime: 3m57s - ExecTreeExecTime: 5s771ms - OpenTime: 247.396ms - ExecTreeOpenTime: 2.971ms - PrepareTime: 409.571ms - ExecTreePrepareTime: 62.133ms KrpcDataStreamSender (dst_id=18):(Total: 3s379ms, non-child: 3s379ms, % non-child: 100.00%) - BytesSent: 131.28 MB (137661078) - OverallThroughput: 38.85 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.80M (5802847) - RpcRetry: 0 (0) - SerializeBatchTime: 3s191ms - UncompressedRowBatchSize: 204.76 MB (214705339) CodeGen:(Total: 399.540ms, non-child: 399.540ms, % non-child: 100.00%) - CodegenTime: 3.735ms - CompileTime: 38.320ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 198.832ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 159.640ms HDFS_SCAN_NODE (id=1):(Total: 5s880ms, non-child: 5s880ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:234/605.73 MB 1:296/788.17 MB 7:240/589.29 MB 5:240/638.02 MB -1:33/85.87 MB 0:241/686.67 MB 6:265/681.67 MB 4:255/673.09 MB 3:251/655.92 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 441ms Hdfs Read Thread Concurrency Bucket: 0:99.78% 1:0.2217% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:164 PARQUET/Unknown(Skipped):1891 BytesRead(4s000ms): 2.14 MB, 14.70 MB, 22.58 MB, 29.05 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.06 MB, 30.71 MB, 31.45 MB, 36.53 MB, 47.44 MB, 54.62 MB, 59.58 MB, 70.06 MB, 84.13 MB, 91.49 MB, 105.12 MB - FooterProcessingTime: (Avg: 3.984ms ; Min: 314.753us ; Max: 292.119ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 136.29 MB (142912215) - BytesReadDataNodeCache: 0 - BytesReadLocal: 132.62 MB (139066600) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 132.62 MB (139066600) - CachedFileHandlesHitCount: 935 (935) - CachedFileHandlesMissCount: 25 (25) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s628ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6448381) - PerReadThreadRawHdfsThroughput: 163.55 MB/sec - RemoteScanRanges: 75 (75) - RowBatchQueueGetWaitTime: 4s946ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 5.80M (5802847) - RowsReturned: 5.80M (5802847) - RowsReturnedRate: 986.72 K/sec - ScanRangesComplete: 2.06K (2055) - ScannerThreadsInvoluntaryContextSwitches: 631 (631) - ScannerThreadsTotalWallClockTime: 3m46s - MaterializeTupleTime(*): 33s198ms - ScannerThreadsSysTime: 468.928ms - ScannerThreadsUserTime: 1s866ms - ScannerThreadsVoluntaryContextSwitches: 12.20K (12201) - TotalRawHdfsReadTime(*): 833.350ms - TotalReadThroughput: 601.20 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006066) - Rows rejected: 0 (0) - Rows total: 5.80M (5802847) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2055) - RowGroups processed: 4.32K (4324) - RowGroups rejected: 1 (1) - RowGroups total: 5.75K (5754) - Rows processed: 2.01M (2006066) - Rows rejected: 0 (0) - Rows total: 5.80M (5802847) - Splits processed: 2.02K (2015) - Splits rejected: 1.89K (1891) - Splits total: 2.06K (2055) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006066) - Rows rejected: 0 (0) - Rows total: 5.80M (5802847) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006066) - Rows rejected: 0 (0) - Rows total: 5.80M (5802847) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2006066) - Rows rejected: 0 (0) - Rows total: 5.80M (5802847) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000045 (host=vc1509.foo.com:22000):(Total: 3m58s, non-child: 3m38s, % non-child: 91.58%) Hdfs split stats (:<# splits>/): 2:256/642.95 MB 7:282/760.15 MB 4:234/584.45 MB 6:255/659.89 MB 5:243/663.79 MB -1:28/85.63 MB 0:237/608.40 MB 1:259/793.81 MB 3:235/605.01 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m1s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s Filter 14 arrival: 3m1s MemoryUsage(4s000ms): 1.98 MB, 7.48 MB, 18.81 MB, 33.42 MB, 26.63 MB, 24.70 MB, 47.38 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.32 MB, 47.40 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 47.45 MB, 45.42 MB, 20.85 MB, 24.61 MB, 24.54 MB, 25.65 MB, 20.17 MB, 24.71 MB, 25.39 MB, 21.13 MB, 16.13 MB, 24.74 MB, 19.26 MB, 13.74 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.51 MB (50868493) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1106939172) - RowsProduced: 5.76M (5764349) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m54s - TotalStorageWaitTime: 1s402ms - TotalThreadsInvoluntaryContextSwitches: 1.52K (1525) - TotalThreadsTotalWallClockTime: 7m34s - TotalThreadsSysTime: 956.853ms - TotalThreadsUserTime: 5s469ms - TotalThreadsVoluntaryContextSwitches: 27.16K (27164) Fragment Instance Lifecycle Timings: - ExecTime: 3m52s - ExecTreeExecTime: 8s354ms - OpenTime: 716.494ms - ExecTreeOpenTime: 3.212ms - PrepareTime: 5s258ms - ExecTreePrepareTime: 168.478ms KrpcDataStreamSender (dst_id=18):(Total: 10s095ms, non-child: 10s095ms, % non-child: 100.00%) - BytesSent: 130.41 MB (136745787) - OverallThroughput: 12.92 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.76M (5764349) - RpcRetry: 0 (0) - SerializeBatchTime: 5s596ms - UncompressedRowBatchSize: 203.40 MB (213280913) CodeGen:(Total: 1s291ms, non-child: 1s291ms, % non-child: 100.00%) - CodegenTime: 10.103ms - CompileTime: 164.636ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 498.150ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 611.136ms HDFS_SCAN_NODE (id=1):(Total: 8s677ms, non-child: 8s677ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:256/642.95 MB 7:282/760.15 MB 4:234/584.45 MB 6:255/659.89 MB 5:243/663.79 MB -1:28/85.63 MB 0:237/608.40 MB 1:259/793.81 MB 3:235/605.01 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 166 out of 166 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:99.77% 1:0.2268% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:166 PARQUET/Unknown(Skipped):1863 BytesRead(4s000ms): 0, 1.06 MB, 5.81 MB, 13.99 MB, 16.34 MB, 22.61 MB, 29.93 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 30.01 MB, 32.56 MB, 37.75 MB, 46.46 MB, 55.58 MB, 63.46 MB, 72.98 MB, 87.49 MB, 102.13 MB, 116.18 MB - FooterProcessingTime: (Avg: 3.875ms ; Min: 282.849us ; Max: 286.423ms ; Number of samples: 166) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 138.42 MB (145144925) - BytesReadDataNodeCache: 0 - BytesReadLocal: 133.08 MB (139542946) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 133.08 MB (139542946) - CachedFileHandlesHitCount: 962 (962) - CachedFileHandlesMissCount: 26 (26) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s464ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 166 (166) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.52 MB (6831958) - PerReadThreadRawHdfsThroughput: 150.92 MB/sec - RemoteScanRanges: 78 (78) - RowBatchQueueGetWaitTime: 7s498ms - RowBatchQueuePutWaitTime: 2m48s - RowsRead: 5.76M (5764349) - RowsReturned: 5.76M (5764349) - RowsReturnedRate: 664.25 K/sec - ScanRangesComplete: 2.03K (2029) - ScannerThreadsInvoluntaryContextSwitches: 570 (570) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 36s633ms - ScannerThreadsSysTime: 454.930ms - ScannerThreadsUserTime: 2s004ms - ScannerThreadsVoluntaryContextSwitches: 13.08K (13079) - TotalRawHdfsReadTime(*): 917.193ms - TotalReadThroughput: 611.76 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.11M (2112720) - Rows rejected: 0 (0) - Rows total: 5.76M (5764349) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.03K (2029) - RowGroups processed: 4.29K (4288) - RowGroups rejected: 1 (1) - RowGroups total: 5.71K (5714) - Rows processed: 2.11M (2112720) - Rows rejected: 0 (0) - Rows total: 5.76M (5764349) - Splits processed: 1.99K (1994) - Splits rejected: 1.86K (1863) - Splits total: 2.03K (2029) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.11M (2112720) - Rows rejected: 0 (0) - Rows total: 5.76M (5764349) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.11M (2112720) - Rows rejected: 0 (0) - Rows total: 5.76M (5764349) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.11M (2112720) - Rows rejected: 0 (0) - Rows total: 5.76M (5764349) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003a (host=vc1507.foo.com:22000):(Total: 3m58s, non-child: 3m45s, % non-child: 94.56%) Hdfs split stats (:<# splits>/): 3:229/643.61 MB 2:229/585.39 MB 5:247/647.23 MB 1:242/643.74 MB 7:237/641.25 MB 4:277/698.30 MB -1:34/88.79 MB 0:276/729.56 MB 6:270/728.70 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m1s Filter 14 arrival: 3m Filter 13 arrival: 3m Filter 12 arrival: 3m1s MemoryUsage(4s000ms): 4.04 MB, 23.45 MB, 23.78 MB, 47.77 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.88 MB, 47.95 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 43.67 MB, 19.83 MB, 21.46 MB, 24.48 MB, 23.12 MB, 18.40 MB, 21.67 MB, 22.10 MB, 23.45 MB, 24.58 MB, 23.63 MB, 12.47 MB, 7.46 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.01 MB (50344591) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1103235426) - RowsProduced: 5.58M (5584768) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m5s - TotalStorageWaitTime: 1s107ms - TotalThreadsInvoluntaryContextSwitches: 1.52K (1525) - TotalThreadsTotalWallClockTime: 7m39s - TotalThreadsSysTime: 1s011ms - TotalThreadsUserTime: 5s291ms - TotalThreadsVoluntaryContextSwitches: 25.34K (25335) Fragment Instance Lifecycle Timings: - ExecTime: 3m54s - ExecTreeExecTime: 6s852ms - OpenTime: 542.440ms - ExecTreeOpenTime: 3.593ms - PrepareTime: 2s858ms - ExecTreePrepareTime: 73.315ms KrpcDataStreamSender (dst_id=18):(Total: 4s546ms, non-child: 4s546ms, % non-child: 100.00%) - BytesSent: 126.49 MB (132630818) - OverallThroughput: 27.82 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.58M (5584768) - RpcRetry: 0 (0) - SerializeBatchTime: 2s648ms - UncompressedRowBatchSize: 197.06 MB (206636416) CodeGen:(Total: 1s417ms, non-child: 1s417ms, % non-child: 100.00%) - CodegenTime: 3.244ms - CompileTime: 138.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 362.822ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 816.545ms HDFS_SCAN_NODE (id=1):(Total: 6s987ms, non-child: 6s987ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:229/643.61 MB 2:229/585.39 MB 5:247/647.23 MB 1:242/643.74 MB 7:237/641.25 MB 4:277/698.30 MB -1:34/88.79 MB 0:276/729.56 MB 6:270/728.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 161 out of 161 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:161 PARQUET/Unknown(Skipped):1880 BytesRead(4s000ms): 0, 8.52 MB, 23.24 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 30.38 MB, 31.65 MB, 32.45 MB, 36.41 MB, 44.68 MB, 54.64 MB, 64.51 MB, 70.06 MB, 83.35 MB, 94.26 MB, 107.63 MB - FooterProcessingTime: (Avg: 2.497ms ; Min: 362.741us ; Max: 50.266ms ; Number of samples: 161) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 133.45 MB (139935179) - BytesReadDataNodeCache: 0 - BytesReadLocal: 129.07 MB (135343759) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 129.07 MB (135343759) - CachedFileHandlesHitCount: 915 (915) - CachedFileHandlesMissCount: 32 (32) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s962ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 161 (161) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.09 MB (6383018) - PerReadThreadRawHdfsThroughput: 172.88 MB/sec - RemoteScanRanges: 96 (96) - RowBatchQueueGetWaitTime: 6s235ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 5.58M (5584768) - RowsReturned: 5.58M (5584768) - RowsReturnedRate: 799.30 K/sec - ScanRangesComplete: 2.04K (2041) - ScannerThreadsInvoluntaryContextSwitches: 620 (620) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 30s377ms - ScannerThreadsSysTime: 494.924ms - ScannerThreadsUserTime: 1s888ms - ScannerThreadsVoluntaryContextSwitches: 12.11K (12107) - TotalRawHdfsReadTime(*): 771.947ms - TotalReadThroughput: 600.68 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965351) - Rows rejected: 0 (0) - Rows total: 5.58M (5584768) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.04K (2041) - RowGroups processed: 4.11K (4112) - RowGroups rejected: 1 (1) - RowGroups total: 5.53K (5530) - Rows processed: 1.97M (1965351) - Rows rejected: 0 (0) - Rows total: 5.58M (5584768) - Splits processed: 2.00K (2002) - Splits rejected: 1.88K (1880) - Splits total: 2.04K (2041) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965351) - Rows rejected: 0 (0) - Rows total: 5.58M (5584768) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965351) - Rows rejected: 0 (0) - Rows total: 5.58M (5584768) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965351) - Rows rejected: 0 (0) - Rows total: 5.58M (5584768) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003d (host=vc1511.foo.com:22000):(Total: 3m57s, non-child: 3m50s, % non-child: 96.95%) Hdfs split stats (:<# splits>/): 3:262/783.65 MB 6:242/635.91 MB 2:245/695.34 MB 7:263/667.17 MB 4:271/683.58 MB 1:266/682.14 MB -1:35/87.88 MB 0:235/618.94 MB 5:216/548.28 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 17.12 MB, 21.60 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.14 MB, 43.21 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 38.28 MB, 18.72 MB, 22.52 MB, 25.48 MB, 24.81 MB, 27.09 MB, 23.67 MB, 19.20 MB, 26.70 MB, 13.97 MB, 10.00 MB, 8.16 MB, 6.27 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 45.62 MB (47838592) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1095448080) - RowsProduced: 5.49M (5487979) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m16s - TotalStorageWaitTime: 1s353ms - TotalThreadsInvoluntaryContextSwitches: 1.60K (1596) - TotalThreadsTotalWallClockTime: 7m37s - TotalThreadsSysTime: 923.859ms - TotalThreadsUserTime: 5s120ms - TotalThreadsVoluntaryContextSwitches: 24.17K (24173) Fragment Instance Lifecycle Timings: - ExecTime: 3m57s - ExecTreeExecTime: 4s518ms - OpenTime: 271.194ms - ExecTreeOpenTime: 3.124ms - PrepareTime: 467.762ms - ExecTreePrepareTime: 57.113ms KrpcDataStreamSender (dst_id=18):(Total: 2s195ms, non-child: 2s195ms, % non-child: 100.00%) - BytesSent: 124.24 MB (130278251) - OverallThroughput: 56.60 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.49M (5487979) - RpcRetry: 0 (0) - SerializeBatchTime: 1s974ms - UncompressedRowBatchSize: 193.65 MB (203055223) CodeGen:(Total: 434.156ms, non-child: 434.156ms, % non-child: 100.00%) - CodegenTime: 6.295ms - CompileTime: 106.505ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 148.682ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 170.129ms HDFS_SCAN_NODE (id=1):(Total: 4s621ms, non-child: 4s621ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:262/783.65 MB 6:242/635.91 MB 2:245/695.34 MB 7:263/667.17 MB 4:271/683.58 MB 1:266/682.14 MB -1:35/87.88 MB 0:235/618.94 MB 5:216/548.28 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 160 out of 160 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 362ms Hdfs Read Thread Concurrency Bucket: 0:98.87% 1:1.134% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:160 PARQUET/Unknown(Skipped):1875 BytesRead(4s000ms): 8.07 MB, 21.71 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.20 MB, 31.93 MB, 35.17 MB, 47.73 MB, 56.80 MB, 67.56 MB, 79.99 MB, 97.43 MB, 103.85 MB, 118.23 MB - FooterProcessingTime: (Avg: 2.506ms ; Min: 277.056us ; Max: 69.272ms ; Number of samples: 160) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 132.55 MB (138987418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 129.76 MB (136063537) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 129.76 MB (136063537) - CachedFileHandlesHitCount: 921 (921) - CachedFileHandlesMissCount: 26 (26) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s244ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 160 (160) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.22 MB (6521147) - PerReadThreadRawHdfsThroughput: 161.00 MB/sec - RemoteScanRanges: 78 (78) - RowBatchQueueGetWaitTime: 3s939ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 5.49M (5487979) - RowsReturned: 5.49M (5487979) - RowsReturnedRate: 1.19 M/sec - ScanRangesComplete: 2.04K (2035) - ScannerThreadsInvoluntaryContextSwitches: 632 (632) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 24s727ms - ScannerThreadsSysTime: 463.929ms - ScannerThreadsUserTime: 1s848ms - ScannerThreadsVoluntaryContextSwitches: 11.29K (11286) - TotalRawHdfsReadTime(*): 823.278ms - TotalReadThroughput: 614.16 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968261) - Rows rejected: 0 (0) - Rows total: 5.49M (5487979) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.04K (2035) - RowGroups processed: 4.01K (4011) - RowGroups rejected: 1 (1) - RowGroups total: 5.44K (5442) - Rows processed: 1.97M (1968261) - Rows rejected: 0 (0) - Rows total: 5.49M (5487979) - Splits processed: 2.00K (1996) - Splits rejected: 1.88K (1875) - Splits total: 2.04K (2035) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968261) - Rows rejected: 0 (0) - Rows total: 5.49M (5487979) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968261) - Rows rejected: 0 (0) - Rows total: 5.49M (5487979) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1968261) - Rows rejected: 0 (0) - Rows total: 5.49M (5487979) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000034 (host=vc1501.foo.com:22000):(Total: 3m53s, non-child: 3m43s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 7:234/593.13 MB 5:261/692.25 MB 2:253/664.79 MB -1:33/88.25 MB 0:256/677.06 MB 4:257/634.62 MB 3:249/645.19 MB 1:268/756.91 MB 6:258/650.83 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m1s Filter 14 arrival: 3m1s Filter 12 arrival: 3m1s Filter 13 arrival: 3m1s MemoryUsage(4s000ms): 15.48 MB, 21.35 MB, 45.19 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.15 MB, 46.23 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 46.28 MB, 28.99 MB, 23.28 MB, 33.35 MB, 22.35 MB, 24.94 MB, 29.26 MB, 21.55 MB, 23.67 MB, 21.33 MB, 15.91 MB, 9.62 MB, 6.56 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 46.28 MB (48527374) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.04 GB (1117483581) - RowsProduced: 5.52M (5518169) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m7s - TotalStorageWaitTime: 1s372ms - TotalThreadsInvoluntaryContextSwitches: 1.62K (1620) - TotalThreadsTotalWallClockTime: 7m34s - TotalThreadsSysTime: 954.854ms - TotalThreadsUserTime: 5s112ms - TotalThreadsVoluntaryContextSwitches: 24.75K (24754) Fragment Instance Lifecycle Timings: - ExecTime: 3m52s - ExecTreeExecTime: 6s606ms - OpenTime: 197.403ms - ExecTreeOpenTime: 2.533ms - PrepareTime: 198.975ms - ExecTreePrepareTime: 43.172ms KrpcDataStreamSender (dst_id=18):(Total: 2s245ms, non-child: 2s245ms, % non-child: 100.00%) - BytesSent: 124.90 MB (130968151) - OverallThroughput: 55.63 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.52M (5518169) - RpcRetry: 0 (0) - SerializeBatchTime: 2s171ms - UncompressedRowBatchSize: 194.71 MB (204172253) CodeGen:(Total: 273.381ms, non-child: 273.381ms, % non-child: 100.00%) - CodegenTime: 2.899ms - CompileTime: 33.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 153.215ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 82.941ms HDFS_SCAN_NODE (id=1):(Total: 6s680ms, non-child: 6s680ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:234/593.13 MB 5:261/692.25 MB 2:253/664.79 MB -1:33/88.25 MB 0:256/677.06 MB 4:257/634.62 MB 3:249/645.19 MB 1:268/756.91 MB 6:258/650.83 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 160 out of 160 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 703ms Hdfs Read Thread Concurrency Bucket: 0:99.77% 1:0.2262% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:160 PARQUET/Unknown(Skipped):1909 BytesRead(4s000ms): 9.81 MB, 22.10 MB, 29.81 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 30.31 MB, 31.26 MB, 38.78 MB, 43.82 MB, 50.15 MB, 62.15 MB, 75.23 MB, 86.57 MB, 103.75 MB, 117.84 MB - FooterProcessingTime: (Avg: 2.962ms ; Min: 275.838us ; Max: 60.972ms ; Number of samples: 160) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 133.85 MB (140354842) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.27 MB (134501818) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.27 MB (134501818) - CachedFileHandlesHitCount: 922 (922) - CachedFileHandlesMissCount: 42 (42) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s938ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 160 (160) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.13 MB (6424151) - PerReadThreadRawHdfsThroughput: 144.59 MB/sec - RemoteScanRanges: 126 (126) - RowBatchQueueGetWaitTime: 5s554ms - RowBatchQueuePutWaitTime: 2m58s - RowsRead: 5.52M (5518169) - RowsReturned: 5.52M (5518169) - RowsReturnedRate: 826.03 K/sec - ScanRangesComplete: 2.07K (2069) - ScannerThreadsInvoluntaryContextSwitches: 670 (670) - ScannerThreadsTotalWallClockTime: 3m41s - MaterializeTupleTime(*): 28s540ms - ScannerThreadsSysTime: 473.927ms - ScannerThreadsUserTime: 1s851ms - ScannerThreadsVoluntaryContextSwitches: 11.77K (11770) - TotalRawHdfsReadTime(*): 925.771ms - TotalReadThroughput: 617.15 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1959257) - Rows rejected: 0 (0) - Rows total: 5.52M (5518169) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2069) - RowGroups processed: 4.03K (4032) - RowGroups rejected: 1 (1) - RowGroups total: 5.46K (5463) - Rows processed: 1.96M (1959257) - Rows rejected: 0 (0) - Rows total: 5.52M (5518169) - Splits processed: 2.03K (2030) - Splits rejected: 1.91K (1909) - Splits total: 2.07K (2069) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1959257) - Rows rejected: 0 (0) - Rows total: 5.52M (5518169) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1959257) - Rows rejected: 0 (0) - Rows total: 5.52M (5518169) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.96M (1959257) - Rows rejected: 0 (0) - Rows total: 5.52M (5518169) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002b (host=vc1524.foo.com:22000):(Total: 3m52s, non-child: 3m42s, % non-child: 95.87%) Hdfs split stats (:<# splits>/): 2:262/681.59 MB 4:282/717.60 MB 5:256/693.94 MB 7:251/631.57 MB 3:219/604.71 MB 6:271/702.36 MB 1:266/697.43 MB -1:33/89.31 MB 0:224/584.82 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m2s Filter 14 arrival: 3m2s Filter 12 arrival: 3m2s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 9.66 MB, 25.06 MB, 39.35 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.08 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 48.16 MB, 43.90 MB, 19.20 MB, 26.32 MB, 16.96 MB, 25.52 MB, 26.92 MB, 28.97 MB, 25.36 MB, 18.54 MB, 8.84 MB, 7.53 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.16 MB (50501733) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1098632457) - RowsProduced: 5.45M (5446294) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m11s - TotalStorageWaitTime: 664.916ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1668) - TotalThreadsTotalWallClockTime: 7m27s - TotalThreadsSysTime: 941.857ms - TotalThreadsUserTime: 5s057ms - TotalThreadsVoluntaryContextSwitches: 23.80K (23798) Fragment Instance Lifecycle Timings: - ExecTime: 3m50s - ExecTreeExecTime: 4s433ms - OpenTime: 216.433ms - ExecTreeOpenTime: 3.649ms - PrepareTime: 1s728ms - ExecTreePrepareTime: 646.212ms KrpcDataStreamSender (dst_id=18):(Total: 3s423ms, non-child: 3s423ms, % non-child: 100.00%) - BytesSent: 123.31 MB (129294689) - OverallThroughput: 36.02 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.45M (5446294) - RpcRetry: 0 (0) - SerializeBatchTime: 2s652ms - UncompressedRowBatchSize: 192.18 MB (201512878) CodeGen:(Total: 477.660ms, non-child: 477.660ms, % non-child: 100.00%) - CodegenTime: 3.873ms - CompileTime: 75.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 117.190ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 253.040ms HDFS_SCAN_NODE (id=1):(Total: 5s715ms, non-child: 5s715ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:262/681.59 MB 4:282/717.60 MB 5:256/693.94 MB 7:251/631.57 MB 3:219/604.71 MB 6:271/702.36 MB 1:266/697.43 MB -1:33/89.31 MB 0:224/584.82 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 162 out of 162 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.54% 1:0.463% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:162 PARQUET/Unknown(Skipped):1902 BytesRead(4s000ms): 2.65 MB, 18.44 MB, 28.38 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.13 MB, 31.44 MB, 34.67 MB, 45.23 MB, 51.17 MB, 61.64 MB, 83.31 MB, 107.25 MB, 115.95 MB - FooterProcessingTime: (Avg: 1.453ms ; Min: 197.044us ; Max: 37.705ms ; Number of samples: 162) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 130.54 MB (136878105) - BytesReadDataNodeCache: 0 - BytesReadLocal: 125.46 MB (131552108) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125.46 MB (131552108) - CachedFileHandlesHitCount: 910 (910) - CachedFileHandlesMissCount: 35 (35) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s398ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 162 (162) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6444975) - PerReadThreadRawHdfsThroughput: 172.11 MB/sec - RemoteScanRanges: 105 (105) - RowBatchQueueGetWaitTime: 4s001ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 5.45M (5446294) - RowsReturned: 5.45M (5446294) - RowsReturnedRate: 952.94 K/sec - ScanRangesComplete: 2.06K (2064) - ScannerThreadsInvoluntaryContextSwitches: 706 (706) - ScannerThreadsTotalWallClockTime: 3m36s - MaterializeTupleTime(*): 25s153ms - ScannerThreadsSysTime: 477.927ms - ScannerThreadsUserTime: 1s786ms - ScannerThreadsVoluntaryContextSwitches: 11.21K (11215) - TotalRawHdfsReadTime(*): 758.450ms - TotalReadThroughput: 613.17 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1952398) - Rows rejected: 0 (0) - Rows total: 5.45M (5446294) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2064) - RowGroups processed: 3.98K (3976) - RowGroups rejected: 1 (1) - RowGroups total: 5.41K (5405) - Rows processed: 1.95M (1952398) - Rows rejected: 0 (0) - Rows total: 5.45M (5446294) - Splits processed: 2.02K (2023) - Splits rejected: 1.90K (1902) - Splits total: 2.06K (2064) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1952398) - Rows rejected: 0 (0) - Rows total: 5.45M (5446294) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1952398) - Rows rejected: 0 (0) - Rows total: 5.45M (5446294) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.95M (1952398) - Rows rejected: 0 (0) - Rows total: 5.45M (5446294) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003b (host=vc1517.foo.com:22000):(Total: 3m52s, non-child: 3m43s, % non-child: 96.19%) Hdfs split stats (:<# splits>/): 1:278/700.13 MB -1:32/90.16 MB 0:258/652.46 MB 3:267/686.69 MB 4:258/672.71 MB 2:246/658.33 MB 7:246/704.36 MB 5:268/680.68 MB 6:220/559.52 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s Filter 14 arrival: 3m1s MemoryUsage(4s000ms): 14.29 MB, 45.22 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.10 MB, 48.16 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 48.23 MB, 47.56 MB, 45.81 MB, 24.85 MB, 24.42 MB, 25.55 MB, 14.18 MB, 25.94 MB, 26.90 MB, 23.92 MB, 26.81 MB, 12.51 MB, 9.61 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.23 MB (50572380) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1094859102) - RowsProduced: 5.62M (5617502) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m15s - TotalStorageWaitTime: 921.481ms - TotalThreadsInvoluntaryContextSwitches: 1.50K (1502) - TotalThreadsTotalWallClockTime: 7m31s - TotalThreadsSysTime: 959.853ms - TotalThreadsUserTime: 5s097ms - TotalThreadsVoluntaryContextSwitches: 23.01K (23014) Fragment Instance Lifecycle Timings: - ExecTime: 3m50s - ExecTreeExecTime: 5s062ms - OpenTime: 237.868ms - ExecTreeOpenTime: 2.752ms - PrepareTime: 845.438ms - ExecTreePrepareTime: 264.622ms KrpcDataStreamSender (dst_id=18):(Total: 2s873ms, non-child: 2s873ms, % non-child: 100.00%) - BytesSent: 127.11 MB (133280438) - OverallThroughput: 44.24 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.62M (5617502) - RpcRetry: 0 (0) - SerializeBatchTime: 2s485ms - UncompressedRowBatchSize: 198.22 MB (207847574) CodeGen:(Total: 395.032ms, non-child: 395.032ms, % non-child: 100.00%) - CodegenTime: 2.321ms - CompileTime: 63.342ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 155.667ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 166.765ms HDFS_SCAN_NODE (id=1):(Total: 5s580ms, non-child: 5s580ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:278/700.13 MB -1:32/90.16 MB 0:258/652.46 MB 3:267/686.69 MB 4:258/672.71 MB 2:246/658.33 MB 7:246/704.36 MB 5:268/680.68 MB 6:220/559.52 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.77% 1:0.2278% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:164 PARQUET/Unknown(Skipped):1909 BytesRead(4s000ms): 5.69 MB, 30.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.04 MB, 31.75 MB, 32.17 MB, 33.12 MB, 44.87 MB, 60.24 MB, 66.50 MB, 75.49 MB, 96.97 MB, 117.53 MB, 124.70 MB - FooterProcessingTime: (Avg: 1.735ms ; Min: 227.645us ; Max: 45.565ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 133.23 MB (139700252) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.46 MB (134697857) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.46 MB (134697857) - CachedFileHandlesHitCount: 918 (918) - CachedFileHandlesMissCount: 30 (30) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s409ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.22 MB (6522964) - PerReadThreadRawHdfsThroughput: 165.27 MB/sec - RemoteScanRanges: 90 (90) - RowBatchQueueGetWaitTime: 4s662ms - RowBatchQueuePutWaitTime: 3m7s - RowsRead: 5.62M (5617502) - RowsReturned: 5.62M (5617502) - RowsReturnedRate: 1.01 M/sec - ScanRangesComplete: 2.07K (2073) - ScannerThreadsInvoluntaryContextSwitches: 597 (597) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 20s986ms - ScannerThreadsSysTime: 469.928ms - ScannerThreadsUserTime: 1s850ms - ScannerThreadsVoluntaryContextSwitches: 10.80K (10797) - TotalRawHdfsReadTime(*): 806.130ms - TotalReadThroughput: 617.31 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2030462) - Rows rejected: 0 (0) - Rows total: 5.62M (5617502) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2073) - RowGroups processed: 4.15K (4153) - RowGroups rejected: 1 (1) - RowGroups total: 5.57K (5571) - Rows processed: 2.03M (2030462) - Rows rejected: 0 (0) - Rows total: 5.62M (5617502) - Splits processed: 2.04K (2035) - Splits rejected: 1.91K (1909) - Splits total: 2.07K (2073) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2030462) - Rows rejected: 0 (0) - Rows total: 5.62M (5617502) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2030462) - Rows rejected: 0 (0) - Rows total: 5.62M (5617502) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2030462) - Rows rejected: 0 (0) - Rows total: 5.62M (5617502) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000036 (host=vc1531.foo.com:22000):(Total: 3m47s, non-child: 3m35s, % non-child: 94.79%) Hdfs split stats (:<# splits>/): 7:235/647.40 MB 4:267/721.20 MB 1:245/663.88 MB 3:253/641.24 MB 6:249/647.56 MB -1:33/88.12 MB 0:254/728.97 MB 5:256/649.23 MB 2:243/616.17 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m3s Filter 12 arrival: 3m3s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 19.83 MB, 24.68 MB, 46.60 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.01 MB, 47.03 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 47.15 MB, 46.65 MB, 39.78 MB, 17.33 MB, 26.12 MB, 20.52 MB, 28.35 MB, 22.81 MB, 23.92 MB, 25.90 MB, 23.90 MB, 18.01 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.15 MB (49436436) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.03 GB (1109116314) - RowsProduced: 5.65M (5653062) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m3s - TotalStorageWaitTime: 3s714ms - TotalThreadsInvoluntaryContextSwitches: 1.30K (1302) - TotalThreadsTotalWallClockTime: 7m27s - TotalThreadsSysTime: 1s032ms - TotalThreadsUserTime: 5s035ms - TotalThreadsVoluntaryContextSwitches: 24.86K (24856) Fragment Instance Lifecycle Timings: - ExecTime: 3m46s - ExecTreeExecTime: 8s295ms - OpenTime: 214.226ms - ExecTreeOpenTime: 2.828ms - PrepareTime: 449.422ms - ExecTreePrepareTime: 164.667ms KrpcDataStreamSender (dst_id=18):(Total: 2s856ms, non-child: 2s856ms, % non-child: 100.00%) - BytesSent: 127.92 MB (134134997) - OverallThroughput: 44.79 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.65M (5653062) - RpcRetry: 0 (0) - SerializeBatchTime: 2s749ms - UncompressedRowBatchSize: 199.47 MB (209163294) CodeGen:(Total: 379.898ms, non-child: 379.898ms, % non-child: 100.00%) - CodegenTime: 7.960ms - CompileTime: 47.738ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 141.028ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 188.291ms HDFS_SCAN_NODE (id=1):(Total: 8s613ms, non-child: 8s613ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:235/647.40 MB 4:267/721.20 MB 1:245/663.88 MB 3:253/641.24 MB 6:249/647.56 MB -1:33/88.12 MB 0:254/728.97 MB 5:256/649.23 MB 2:243/616.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 159 out of 159 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 422ms Hdfs Read Thread Concurrency Bucket: 0:99.55% 1:0.4535% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:159 PARQUET/Unknown(Skipped):1876 BytesRead(4s000ms): 6.71 MB, 23.20 MB, 30.17 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.28 MB, 30.73 MB, 34.13 MB, 43.18 MB, 52.05 MB, 58.14 MB, 72.12 MB, 93.78 MB, 108.29 MB, 118.83 MB - FooterProcessingTime: (Avg: 10.216ms ; Min: 393.972us ; Max: 170.182ms ; Number of samples: 159) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 133.01 MB (139475016) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.61 MB (133810128) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.61 MB (133810128) - CachedFileHandlesHitCount: 888 (888) - CachedFileHandlesMissCount: 39 (39) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s438ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 159 (159) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.02 MB (6307709) - PerReadThreadRawHdfsThroughput: 141.93 MB/sec - RemoteScanRanges: 111 (111) - RowBatchQueueGetWaitTime: 7s266ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 5.65M (5653062) - RowsReturned: 5.65M (5653062) - RowsReturnedRate: 656.34 K/sec - ScanRangesComplete: 2.04K (2035) - ScannerThreadsInvoluntaryContextSwitches: 480 (480) - ScannerThreadsTotalWallClockTime: 3m40s - MaterializeTupleTime(*): 26s462ms - ScannerThreadsSysTime: 500.923ms - ScannerThreadsUserTime: 1s764ms - ScannerThreadsVoluntaryContextSwitches: 11.80K (11801) - TotalRawHdfsReadTime(*): 937.209ms - TotalReadThroughput: 611.98 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965898) - Rows rejected: 0 (0) - Rows total: 5.65M (5653062) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.04K (2035) - RowGroups processed: 4.17K (4174) - RowGroups rejected: 1 (1) - RowGroups total: 5.60K (5600) - Rows processed: 1.97M (1965898) - Rows rejected: 0 (0) - Rows total: 5.65M (5653062) - Splits processed: 2.00K (1997) - Splits rejected: 1.88K (1876) - Splits total: 2.04K (2035) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965898) - Rows rejected: 0 (0) - Rows total: 5.65M (5653062) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965898) - Rows rejected: 0 (0) - Rows total: 5.65M (5653062) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.97M (1965898) - Rows rejected: 0 (0) - Rows total: 5.65M (5653062) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002e (host=vc1527.foo.com:22000):(Total: 3m45s, non-child: 3m36s, % non-child: 95.88%) Hdfs split stats (:<# splits>/): 6:254/647.68 MB 1:258/676.91 MB 2:249/728.75 MB 3:258/644.76 MB 7:249/633.76 MB 4:261/667.05 MB 5:270/688.42 MB -1:30/85.31 MB 0:233/629.30 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m3s Filter 14 arrival: 3m2s Filter 12 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 8.62 MB, 26.22 MB, 20.50 MB, 44.33 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.03 MB, 48.07 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 48.17 MB, 39.74 MB, 19.17 MB, 27.09 MB, 21.93 MB, 25.68 MB, 19.35 MB, 22.73 MB, 25.88 MB, 13.83 MB, 8.60 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.17 MB (50507271) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1093049150) - RowsProduced: 5.54M (5543129) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m1s - TotalStorageWaitTime: 967.058ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1587) - TotalThreadsTotalWallClockTime: 7m22s - TotalThreadsSysTime: 1s003ms - TotalThreadsUserTime: 5s094ms - TotalThreadsVoluntaryContextSwitches: 24.07K (24065) Fragment Instance Lifecycle Timings: - ExecTime: 3m44s - ExecTreeExecTime: 6s036ms - OpenTime: 199.462ms - ExecTreeOpenTime: 2.836ms - PrepareTime: 444.759ms - ExecTreePrepareTime: 79.144ms KrpcDataStreamSender (dst_id=18):(Total: 2s843ms, non-child: 2s843ms, % non-child: 100.00%) - BytesSent: 125.53 MB (131628724) - OverallThroughput: 44.15 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.54M (5543129) - RpcRetry: 0 (0) - SerializeBatchTime: 2s566ms - UncompressedRowBatchSize: 195.59 MB (205095773) CodeGen:(Total: 270.553ms, non-child: 270.553ms, % non-child: 100.00%) - CodegenTime: 4.830ms - CompileTime: 64.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 128.933ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 74.424ms HDFS_SCAN_NODE (id=1):(Total: 6s182ms, non-child: 6s182ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:254/647.68 MB 1:258/676.91 MB 2:249/728.75 MB 3:258/644.76 MB 7:249/633.76 MB 4:261/667.05 MB 5:270/688.42 MB -1:30/85.31 MB 0:233/629.30 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 173 out of 173 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 441ms Hdfs Read Thread Concurrency Bucket: 0:99.77% 1:0.2304% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:173 PARQUET/Unknown(Skipped):1889 BytesRead(4s000ms): 1.70 MB, 10.99 MB, 21.51 MB, 30.91 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.06 MB, 32.49 MB, 36.64 MB, 41.92 MB, 53.62 MB, 66.65 MB, 80.05 MB, 90.39 MB, 115.43 MB - FooterProcessingTime: (Avg: 2.081ms ; Min: 280.705us ; Max: 70.925ms ; Number of samples: 173) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 130.89 MB (137246706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 125.82 MB (131933443) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125.82 MB (131933443) - CachedFileHandlesHitCount: 934 (934) - CachedFileHandlesMissCount: 37 (37) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s478ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 173 (173) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.06 MB (6349694) - PerReadThreadRawHdfsThroughput: 164.34 MB/sec - RemoteScanRanges: 111 (111) - RowBatchQueueGetWaitTime: 5s206ms - RowBatchQueuePutWaitTime: 2m57s - RowsRead: 5.54M (5543129) - RowsReturned: 5.54M (5543129) - RowsReturnedRate: 896.51 K/sec - ScanRangesComplete: 2.06K (2062) - ScannerThreadsInvoluntaryContextSwitches: 681 (681) - ScannerThreadsTotalWallClockTime: 3m37s - MaterializeTupleTime(*): 28s857ms - ScannerThreadsSysTime: 502.923ms - ScannerThreadsUserTime: 1s803ms - ScannerThreadsVoluntaryContextSwitches: 11.62K (11619) - TotalRawHdfsReadTime(*): 796.430ms - TotalReadThroughput: 614.59 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2027313) - Rows rejected: 0 (0) - Rows total: 5.54M (5543129) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2062) - RowGroups processed: 4.07K (4073) - RowGroups rejected: 1 (1) - RowGroups total: 5.50K (5503) - Rows processed: 2.03M (2027313) - Rows rejected: 0 (0) - Rows total: 5.54M (5543129) - Splits processed: 2.02K (2015) - Splits rejected: 1.89K (1889) - Splits total: 2.06K (2062) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2027313) - Rows rejected: 0 (0) - Rows total: 5.54M (5543129) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2027313) - Rows rejected: 0 (0) - Rows total: 5.54M (5543129) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.03M (2027313) - Rows rejected: 0 (0) - Rows total: 5.54M (5543129) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000032 (host=vc1520.foo.com:22000):(Total: 3m43s, non-child: 3m35s, % non-child: 96.53%) Hdfs split stats (:<# splits>/): 6:218/569.13 MB 5:267/694.96 MB 7:248/658.60 MB 4:261/677.34 MB 3:265/678.64 MB 1:238/720.85 MB -1:33/83.08 MB 0:249/608.50 MB 2:272/711.05 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 18.52 MB, 20.30 MB, 44.60 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.01 MB, 48.07 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 48.15 MB, 40.88 MB, 19.31 MB, 21.21 MB, 22.03 MB, 24.26 MB, 15.15 MB, 20.62 MB, 21.60 MB, 12.58 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.15 MB (50486359) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.01 GB (1086609159) - RowsProduced: 5.66M (5656164) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m7s - TotalStorageWaitTime: 2s536ms - TotalThreadsInvoluntaryContextSwitches: 1.70K (1695) - TotalThreadsTotalWallClockTime: 7m17s - TotalThreadsSysTime: 945.855ms - TotalThreadsUserTime: 5s189ms - TotalThreadsVoluntaryContextSwitches: 22.95K (22951) Fragment Instance Lifecycle Timings: - ExecTime: 3m42s - ExecTreeExecTime: 5s017ms - OpenTime: 216.975ms - ExecTreeOpenTime: 2.245ms - PrepareTime: 242.355ms - ExecTreePrepareTime: 68.175ms KrpcDataStreamSender (dst_id=18):(Total: 2s323ms, non-child: 2s323ms, % non-child: 100.00%) - BytesSent: 128.03 MB (134250227) - OverallThroughput: 55.11 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.66M (5656164) - RpcRetry: 0 (0) - SerializeBatchTime: 2s215ms - UncompressedRowBatchSize: 199.58 MB (209278068) CodeGen:(Total: 277.906ms, non-child: 277.906ms, % non-child: 100.00%) - CodegenTime: 3.428ms - CompileTime: 89.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 122.264ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 62.866ms HDFS_SCAN_NODE (id=1):(Total: 5s142ms, non-child: 5s142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:218/569.13 MB 5:267/694.96 MB 7:248/658.60 MB 4:261/677.34 MB 3:265/678.64 MB 1:238/720.85 MB -1:33/83.08 MB 0:249/608.50 MB 2:272/711.05 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 167 out of 167 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 622ms Hdfs Read Thread Concurrency Bucket: 0:99.53% 1:0.4673% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:167 PARQUET/Unknown(Skipped):1884 BytesRead(4s000ms): 7.64 MB, 20.98 MB, 29.86 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 30.73 MB, 31.22 MB, 35.53 MB, 48.07 MB, 60.66 MB, 79.35 MB, 99.71 MB, 107.17 MB - FooterProcessingTime: (Avg: 10.138ms ; Min: 281.289us ; Max: 545.130ms ; Number of samples: 167) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 138.24 MB (144956042) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.06 MB (141617694) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.06 MB (141617694) - CachedFileHandlesHitCount: 982 (982) - CachedFileHandlesMissCount: 25 (25) - CollectionItemsRead: 0 (0) - DecompressionTime: 959.679ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 167 (167) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.23 MB (6531629) - PerReadThreadRawHdfsThroughput: 176.77 MB/sec - RemoteScanRanges: 75 (75) - RowBatchQueueGetWaitTime: 4s128ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 5.66M (5656164) - RowsReturned: 5.66M (5656164) - RowsReturnedRate: 1.10 M/sec - ScanRangesComplete: 2.05K (2051) - ScannerThreadsInvoluntaryContextSwitches: 693 (693) - ScannerThreadsTotalWallClockTime: 3m34s - MaterializeTupleTime(*): 20s393ms - ScannerThreadsSysTime: 453.930ms - ScannerThreadsUserTime: 1s889ms - ScannerThreadsVoluntaryContextSwitches: 10.62K (10620) - TotalRawHdfsReadTime(*): 782.032ms - TotalReadThroughput: 653.51 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052606) - Rows rejected: 0 (0) - Rows total: 5.66M (5656164) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2051) - RowGroups processed: 4.18K (4178) - RowGroups rejected: 1 (1) - RowGroups total: 5.61K (5605) - Rows processed: 2.05M (2052606) - Rows rejected: 0 (0) - Rows total: 5.66M (5656164) - Splits processed: 2.01K (2011) - Splits rejected: 1.88K (1884) - Splits total: 2.05K (2051) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052606) - Rows rejected: 0 (0) - Rows total: 5.66M (5656164) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052606) - Rows rejected: 0 (0) - Rows total: 5.66M (5656164) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052606) - Rows rejected: 0 (0) - Rows total: 5.66M (5656164) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003c (host=vc1502.foo.com:22000):(Total: 3m42s, non-child: 3m38s, % non-child: 98.17%) Hdfs split stats (:<# splits>/): 1:272/708.10 MB 2:258/764.48 MB 6:255/680.94 MB 4:232/601.25 MB 7:231/601.22 MB 3:236/574.89 MB 5:259/654.35 MB -1:31/87.32 MB 0:278/730.26 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m2s Filter 14 arrival: 3m1s Filter 12 arrival: 3m1s Filter 13 arrival: 3m1s MemoryUsage(4s000ms): 25.96 MB, 40.76 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.08 MB, 48.15 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 48.22 MB, 47.81 MB, 41.22 MB, 23.41 MB, 25.39 MB, 32.16 MB, 17.39 MB, 16.04 MB, 15.73 MB, 12.27 MB, 8.35 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.22 MB (50559025) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 994.65 MB (1042962787) - RowsProduced: 6.31M (6305578) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m25s - TotalStorageWaitTime: 952.187ms - TotalThreadsInvoluntaryContextSwitches: 1.47K (1469) - TotalThreadsTotalWallClockTime: 7m4s - TotalThreadsSysTime: 869.867ms - TotalThreadsUserTime: 5s120ms - TotalThreadsVoluntaryContextSwitches: 19.56K (19560) Fragment Instance Lifecycle Timings: - ExecTime: 3m41s - ExecTreeExecTime: 2s077ms - OpenTime: 182.516ms - ExecTreeOpenTime: 2.916ms - PrepareTime: 318.885ms - ExecTreePrepareTime: 37.853ms KrpcDataStreamSender (dst_id=18):(Total: 1s589ms, non-child: 1s589ms, % non-child: 100.00%) - BytesSent: 142.77 MB (149705541) - OverallThroughput: 89.80 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.31M (6305578) - RpcRetry: 0 (0) - SerializeBatchTime: 1s476ms - UncompressedRowBatchSize: 222.50 MB (233306386) CodeGen:(Total: 337.071ms, non-child: 337.071ms, % non-child: 100.00%) - CodegenTime: 4.851ms - CompileTime: 51.276ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 125.696ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 127.612ms HDFS_SCAN_NODE (id=1):(Total: 2s144ms, non-child: 2s144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:272/708.10 MB 2:258/764.48 MB 6:255/680.94 MB 4:232/601.25 MB 7:231/601.22 MB 3:236/574.89 MB 5:259/654.35 MB -1:31/87.32 MB 0:278/730.26 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 186 out of 186 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 582ms Hdfs Read Thread Concurrency Bucket: 0:99.51% 1:0.4938% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:186 PARQUET/Unknown(Skipped):1866 BytesRead(4s000ms): 17.90 MB, 42.06 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.75 MB, 44.83 MB, 45.42 MB, 50.74 MB, 79.40 MB, 113.79 MB - FooterProcessingTime: (Avg: 2.078ms ; Min: 415.759us ; Max: 108.765ms ; Number of samples: 186) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 148.77 MB (155995104) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.95 MB (147795422) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.95 MB (147795422) - CachedFileHandlesHitCount: 1.02K (1023) - CachedFileHandlesMissCount: 46 (46) - CollectionItemsRead: 0 (0) - DecompressionTime: 446.225ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 186 (186) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6450639) - PerReadThreadRawHdfsThroughput: 159.84 MB/sec - RemoteScanRanges: 135 (135) - RowBatchQueueGetWaitTime: 1s381ms - RowBatchQueuePutWaitTime: 3m11s - RowsRead: 6.31M (6305578) - RowsReturned: 6.31M (6305578) - RowsReturnedRate: 2.94 M/sec - ScanRangesComplete: 2.05K (2052) - ScannerThreadsInvoluntaryContextSwitches: 618 (618) - ScannerThreadsTotalWallClockTime: 3m22s - MaterializeTupleTime(*): 6s841ms - ScannerThreadsSysTime: 443.932ms - ScannerThreadsUserTime: 1s826ms - ScannerThreadsVoluntaryContextSwitches: 8.80K (8804) - TotalRawHdfsReadTime(*): 930.723ms - TotalReadThroughput: 705.52 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052116) - Rows rejected: 0 (0) - Rows total: 6.31M (6305578) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2052) - RowGroups processed: 4.17K (4173) - RowGroups rejected: 1 (1) - RowGroups total: 6.26K (6256) - Rows processed: 2.05M (2052116) - Rows rejected: 0 (0) - Rows total: 6.31M (6305578) - Splits processed: 1.99K (1993) - Splits rejected: 1.87K (1866) - Splits total: 2.05K (2052) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052116) - Rows rejected: 0 (0) - Rows total: 6.31M (6305578) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052116) - Rows rejected: 0 (0) - Rows total: 6.31M (6305578) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.05M (2052116) - Rows rejected: 0 (0) - Rows total: 6.31M (6305578) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000003f (host=vc1508.foo.com:22000):(Total: 3m41s, non-child: 3m36s, % non-child: 97.48%) Hdfs split stats (:<# splits>/): -1:33/87.24 MB 0:246/646.28 MB 2:249/661.76 MB 7:251/656.28 MB 5:279/702.25 MB 3:274/718.90 MB 4:230/614.50 MB 6:264/695.45 MB 1:242/620.45 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 14 arrival: 3m1s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s MemoryUsage(4s000ms): 25.19 MB, 30.03 MB, 37.65 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.29 MB, 47.36 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.42 MB, 47.29 MB, 41.55 MB, 14.54 MB, 23.68 MB, 23.58 MB, 18.26 MB, 22.10 MB, 24.43 MB, 13.50 MB, 8.85 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.50 MB (49808277) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1018.77 MB (1068260206) - RowsProduced: 6.30M (6302968) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m9s - TotalStorageWaitTime: 1s341ms - TotalThreadsInvoluntaryContextSwitches: 1.78K (1781) - TotalThreadsTotalWallClockTime: 7m13s - TotalThreadsSysTime: 986.850ms - TotalThreadsUserTime: 5s349ms - TotalThreadsVoluntaryContextSwitches: 22.59K (22595) Fragment Instance Lifecycle Timings: - ExecTime: 3m41s - ExecTreeExecTime: 2s782ms - OpenTime: 192.452ms - ExecTreeOpenTime: 3.471ms - PrepareTime: 372.827ms - ExecTreePrepareTime: 39.301ms KrpcDataStreamSender (dst_id=18):(Total: 2s363ms, non-child: 2s363ms, % non-child: 100.00%) - BytesSent: 142.63 MB (149560359) - OverallThroughput: 60.36 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.30M (6302968) - RpcRetry: 0 (0) - SerializeBatchTime: 2s219ms - UncompressedRowBatchSize: 222.41 MB (233209816) CodeGen:(Total: 369.634ms, non-child: 369.634ms, % non-child: 100.00%) - CodegenTime: 1.769ms - CompileTime: 66.613ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 113.396ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 168.922ms HDFS_SCAN_NODE (id=1):(Total: 2s850ms, non-child: 2s850ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:33/87.24 MB 0:246/646.28 MB 2:249/661.76 MB 7:251/656.28 MB 5:279/702.25 MB 3:274/718.90 MB 4:230/614.50 MB 6:264/695.45 MB 1:242/620.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 183 out of 183 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 521ms Hdfs Read Thread Concurrency Bucket: 0:99.76% 1:0.237% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:183 PARQUET/Unknown(Skipped):1885 BytesRead(4s000ms): 15.56 MB, 31.18 MB, 41.79 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.71 MB, 44.80 MB, 45.41 MB, 47.24 MB, 58.30 MB, 77.56 MB, 92.85 MB, 103.99 MB - FooterProcessingTime: (Avg: 3.548ms ; Min: 293.167us ; Max: 269.652ms ; Number of samples: 183) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 148.54 MB (155757055) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.01 MB (148906994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.01 MB (148906994) - CachedFileHandlesHitCount: 1.02K (1018) - CachedFileHandlesMissCount: 38 (38) - CollectionItemsRead: 0 (0) - DecompressionTime: 848.518ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 183 (183) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.58 MB (6898719) - PerReadThreadRawHdfsThroughput: 148.64 MB/sec - RemoteScanRanges: 114 (114) - RowBatchQueueGetWaitTime: 1s986ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 6.30M (6302968) - RowsReturned: 6.30M (6302968) - RowsReturnedRate: 2.21 M/sec - ScanRangesComplete: 2.07K (2068) - ScannerThreadsInvoluntaryContextSwitches: 745 (745) - ScannerThreadsTotalWallClockTime: 3m32s - MaterializeTupleTime(*): 18s543ms - ScannerThreadsSysTime: 491.925ms - ScannerThreadsUserTime: 1s944ms - ScannerThreadsVoluntaryContextSwitches: 10.48K (10481) - TotalRawHdfsReadTime(*): 999.323ms - TotalReadThroughput: 700.07 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1992869) - Rows rejected: 0 (0) - Rows total: 6.30M (6302968) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2068) - RowGroups processed: 4.16K (4156) - RowGroups rejected: 1 (1) - RowGroups total: 6.25K (6248) - Rows processed: 1.99M (1992869) - Rows rejected: 0 (0) - Rows total: 6.30M (6302968) - Splits processed: 2.01K (2008) - Splits rejected: 1.89K (1885) - Splits total: 2.07K (2068) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1992869) - Rows rejected: 0 (0) - Rows total: 6.30M (6302968) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1992869) - Rows rejected: 0 (0) - Rows total: 6.30M (6302968) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1992869) - Rows rejected: 0 (0) - Rows total: 6.30M (6302968) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000002d (host=vc1504.foo.com:22000):(Total: 3m40s, non-child: 3m34s, % non-child: 97.17%) Hdfs split stats (:<# splits>/): -1:32/85.79 MB 0:282/852.08 MB 5:261/692.61 MB 7:230/557.16 MB 6:261/650.09 MB 2:270/702.55 MB 3:245/628.48 MB 4:240/597.90 MB 1:258/635.36 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m1s Filter 14 arrival: 3m Filter 13 arrival: 3m Filter 12 arrival: 3m MemoryUsage(4s000ms): 42.36 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.75 MB, 84.83 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 84.88 MB, 47.98 MB, 19.78 MB, 23.65 MB, 20.70 MB, 26.96 MB, 22.81 MB, 21.24 MB, 16.96 MB, 9.89 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 88.71 MB (93024086) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1007.28 MB (1056205803) - RowsProduced: 5.84M (5840531) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m13s - TotalStorageWaitTime: 723.046ms - TotalThreadsInvoluntaryContextSwitches: 1.48K (1479) - TotalThreadsTotalWallClockTime: 7m8s - TotalThreadsSysTime: 846.871ms - TotalThreadsUserTime: 5s094ms - TotalThreadsVoluntaryContextSwitches: 21.42K (21420) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 2s158ms - OpenTime: 140.695ms - ExecTreeOpenTime: 2.244ms - PrepareTime: 910.893ms - ExecTreePrepareTime: 282.721ms KrpcDataStreamSender (dst_id=18):(Total: 3s137ms, non-child: 3s137ms, % non-child: 100.00%) - BytesSent: 128.88 MB (135143490) - OverallThroughput: 41.07 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.84M (5840531) - RpcRetry: 0 (0) - SerializeBatchTime: 2s767ms - UncompressedRowBatchSize: 206.09 MB (216099647) CodeGen:(Total: 393.651ms, non-child: 393.651ms, % non-child: 100.00%) - CodegenTime: 1.889ms - CompileTime: 20.407ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 112.205ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 243.429ms HDFS_SCAN_NODE (id=1):(Total: 2s713ms, non-child: 2s713ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:32/85.79 MB 0:282/852.08 MB 5:261/692.61 MB 7:230/557.16 MB 6:261/650.09 MB 2:270/702.55 MB 3:245/628.48 MB 4:240/597.90 MB 1:258/635.36 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 135 out of 135 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 100ms Hdfs Read Thread Concurrency Bucket: 0:99.28% 1:0.7212% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:135 PARQUET/Unknown(Skipped):1944 BytesRead(4s000ms): 20.05 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.59 MB, 38.90 MB, 44.16 MB, 57.40 MB, 73.40 MB, 85.62 MB, 119.15 MB - FooterProcessingTime: (Avg: 2.119ms ; Min: 273.761us ; Max: 68.413ms ; Number of samples: 135) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 149.73 MB (156998996) - BytesReadDataNodeCache: 0 - BytesReadLocal: 148.31 MB (155515329) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 148.31 MB (155515329) - CachedFileHandlesHitCount: 843 (843) - CachedFileHandlesMissCount: 12 (12) - CollectionItemsRead: 0 (0) - DecompressionTime: 752.035ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 135 (135) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 46.75 MB (49025463) - PerReadThreadRawHdfsThroughput: 201.70 MB/sec - RemoteScanRanges: 36 (36) - RowBatchQueueGetWaitTime: 1s861ms - RowBatchQueuePutWaitTime: 3m7s - RowsRead: 5.84M (5840531) - RowsReturned: 5.84M (5840531) - RowsReturnedRate: 2.15 M/sec - ScanRangesComplete: 2.08K (2079) - ScannerThreadsInvoluntaryContextSwitches: 594 (594) - ScannerThreadsTotalWallClockTime: 3m28s - MaterializeTupleTime(*): 14s113ms - ScannerThreadsSysTime: 409.937ms - ScannerThreadsUserTime: 1s786ms - ScannerThreadsVoluntaryContextSwitches: 9.81K (9809) - TotalRawHdfsReadTime(*): 742.333ms - TotalReadThroughput: 722.07 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.08M (2080997) - Rows rejected: 0 (0) - Rows total: 5.84M (5840531) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.08K (2079) - RowGroups processed: 4.35K (4350) - RowGroups rejected: 1 (1) - RowGroups total: 5.77K (5771) - Rows processed: 2.08M (2080997) - Rows rejected: 0 (0) - Rows total: 5.84M (5840531) - Splits processed: 2.07K (2073) - Splits rejected: 1.94K (1944) - Splits total: 2.08K (2079) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.08M (2080997) - Rows rejected: 0 (0) - Rows total: 5.84M (5840531) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.08M (2080997) - Rows rejected: 0 (0) - Rows total: 5.84M (5840531) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.08M (2080997) - Rows rejected: 0 (0) - Rows total: 5.84M (5840531) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000028 (host=vc1532.foo.com:22000):(Total: 3m40s, non-child: 3m35s, % non-child: 97.47%) Hdfs split stats (:<# splits>/): 6:269/687.02 MB 2:251/683.73 MB 4:251/649.37 MB 7:237/599.85 MB -1:40/92.76 MB 0:244/629.24 MB 5:225/714.44 MB 1:272/700.87 MB 3:257/647.43 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m3s Filter 12 arrival: 3m2s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 18.18 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.06 MB, 39.08 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 39.19 MB, 29.51 MB, 23.50 MB, 19.87 MB, 24.24 MB, 21.26 MB, 11.55 MB, 9.16 MB, 7.98 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.15 MB (50485034) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1018.53 MB (1068010975) - RowsProduced: 5.46M (5464555) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m18s - TotalStorageWaitTime: 623.551ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1366) - TotalThreadsTotalWallClockTime: 7m1s - TotalThreadsSysTime: 792.880ms - TotalThreadsUserTime: 4s552ms - TotalThreadsVoluntaryContextSwitches: 18.94K (18944) Fragment Instance Lifecycle Timings: - ExecTime: 3m38s - ExecTreeExecTime: 1s972ms - OpenTime: 145.482ms - ExecTreeOpenTime: 2.805ms - PrepareTime: 1s576ms - ExecTreePrepareTime: 262.069ms KrpcDataStreamSender (dst_id=18):(Total: 2s778ms, non-child: 2s778ms, % non-child: 100.00%) - BytesSent: 123.71 MB (129724463) - OverallThroughput: 44.53 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.46M (5464555) - RpcRetry: 0 (0) - SerializeBatchTime: 1s661ms - UncompressedRowBatchSize: 192.82 MB (202188535) CodeGen:(Total: 309.846ms, non-child: 309.846ms, % non-child: 100.00%) - CodegenTime: 1.857ms - CompileTime: 23.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 99.306ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 182.009ms HDFS_SCAN_NODE (id=1):(Total: 2s500ms, non-child: 2s500ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:269/687.02 MB 2:251/683.73 MB 4:251/649.37 MB 7:237/599.85 MB -1:40/92.76 MB 0:244/629.24 MB 5:225/714.44 MB 1:272/700.87 MB 3:257/647.43 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 160 out of 160 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:99.27% 1:0.7317% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:160 PARQUET/Unknown(Skipped):1886 BytesRead(4s000ms): 11.99 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 30.58 MB, 31.04 MB, 42.69 MB, 53.01 MB, 78.23 MB, 108.17 MB - FooterProcessingTime: (Avg: 1.445ms ; Min: 320.047us ; Max: 12.029ms ; Number of samples: 160) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 130.42 MB (136752500) - BytesReadDataNodeCache: 0 - BytesReadLocal: 125.62 MB (131721824) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125.62 MB (131721824) - CachedFileHandlesHitCount: 912 (912) - CachedFileHandlesMissCount: 30 (30) - CollectionItemsRead: 0 (0) - DecompressionTime: 595.965ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 160 (160) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6448499) - PerReadThreadRawHdfsThroughput: 174.92 MB/sec - RemoteScanRanges: 90 (90) - RowBatchQueueGetWaitTime: 1s674ms - RowBatchQueuePutWaitTime: 3m6s - RowsRead: 5.46M (5464555) - RowsReturned: 5.46M (5464555) - RowsReturnedRate: 2.18 M/sec - ScanRangesComplete: 2.05K (2046) - ScannerThreadsInvoluntaryContextSwitches: 600 (600) - ScannerThreadsTotalWallClockTime: 3m22s - MaterializeTupleTime(*): 10s049ms - ScannerThreadsSysTime: 386.941ms - ScannerThreadsUserTime: 1s628ms - ScannerThreadsVoluntaryContextSwitches: 8.48K (8481) - TotalRawHdfsReadTime(*): 745.568ms - TotalReadThroughput: 645.16 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1941746) - Rows rejected: 0 (0) - Rows total: 5.46M (5464555) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2046) - RowGroups processed: 3.98K (3981) - RowGroups rejected: 1 (1) - RowGroups total: 5.42K (5420) - Rows processed: 1.94M (1941746) - Rows rejected: 0 (0) - Rows total: 5.46M (5464555) - Splits processed: 2.01K (2006) - Splits rejected: 1.89K (1886) - Splits total: 2.05K (2046) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1941746) - Rows rejected: 0 (0) - Rows total: 5.46M (5464555) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1941746) - Rows rejected: 0 (0) - Rows total: 5.46M (5464555) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1941746) - Rows rejected: 0 (0) - Rows total: 5.46M (5464555) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000035 (host=vc1533.foo.com:22000):(Total: 3m40s, non-child: 3m35s, % non-child: 97.78%) Hdfs split stats (:<# splits>/): -1:31/85.47 MB 0:224/594.57 MB 7:257/661.52 MB 2:245/625.34 MB 5:247/643.69 MB 3:271/685.53 MB 6:261/658.85 MB 4:272/819.68 MB 1:242/627.28 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m4s Filter 12 arrival: 3m3s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 23.43 MB, 33.05 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.24 MB, 43.26 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 43.38 MB, 35.91 MB, 22.76 MB, 31.20 MB, 19.47 MB, 26.74 MB, 24.74 MB, 15.54 MB, 11.11 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.16 MB (50501802) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1014.12 MB (1063385979) - RowsProduced: 6.32M (6317238) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m17s - TotalStorageWaitTime: 985.288ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1592) - TotalThreadsTotalWallClockTime: 7m6s - TotalThreadsSysTime: 986.850ms - TotalThreadsUserTime: 5s335ms - TotalThreadsVoluntaryContextSwitches: 22.45K (22448) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 2s617ms - OpenTime: 151.363ms - ExecTreeOpenTime: 3.067ms - PrepareTime: 230.204ms - ExecTreePrepareTime: 50.182ms KrpcDataStreamSender (dst_id=18):(Total: 1s960ms, non-child: 1s960ms, % non-child: 100.00%) - BytesSent: 142.81 MB (149751862) - OverallThroughput: 72.86 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.32M (6317238) - RpcRetry: 0 (0) - SerializeBatchTime: 1s854ms - UncompressedRowBatchSize: 222.91 MB (233737806) CodeGen:(Total: 219.767ms, non-child: 219.767ms, % non-child: 100.00%) - CodegenTime: 3.337ms - CompileTime: 30.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 109.293ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 78.169ms HDFS_SCAN_NODE (id=1):(Total: 2s708ms, non-child: 2s708ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:31/85.47 MB 0:224/594.57 MB 7:257/661.52 MB 2:245/625.34 MB 5:247/643.69 MB 3:271/685.53 MB 6:261/658.85 MB 4:272/819.68 MB 1:242/627.28 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 703ms Hdfs Read Thread Concurrency Bucket: 0:99.52% 1:0.4831% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:168 PARQUET/Unknown(Skipped):1882 BytesRead(4s000ms): 17.24 MB, 36.23 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.02 MB, 44.35 MB, 53.23 MB, 73.32 MB, 80.35 MB, 101.99 MB - FooterProcessingTime: (Avg: 2.301ms ; Min: 240.785us ; Max: 62.077ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 148.90 MB (156131626) - BytesReadDataNodeCache: 0 - BytesReadLocal: 142.14 MB (149045625) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 142.14 MB (149045625) - CachedFileHandlesHitCount: 963 (963) - CachedFileHandlesMissCount: 42 (42) - CollectionItemsRead: 0 (0) - DecompressionTime: 665.377ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.20 MB (6505014) - PerReadThreadRawHdfsThroughput: 168.75 MB/sec - RemoteScanRanges: 126 (126) - RowBatchQueueGetWaitTime: 1s731ms - RowBatchQueuePutWaitTime: 3m6s - RowsRead: 6.32M (6317238) - RowsReturned: 6.32M (6317238) - RowsReturnedRate: 2.33 M/sec - ScanRangesComplete: 2.05K (2050) - ScannerThreadsInvoluntaryContextSwitches: 712 (712) - ScannerThreadsTotalWallClockTime: 3m26s - MaterializeTupleTime(*): 13s507ms - ScannerThreadsSysTime: 499.924ms - ScannerThreadsUserTime: 1s892ms - ScannerThreadsVoluntaryContextSwitches: 10.51K (10509) - TotalRawHdfsReadTime(*): 882.369ms - TotalReadThroughput: 734.65 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1873374) - Rows rejected: 0 (0) - Rows total: 6.32M (6317238) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2050) - RowGroups processed: 4.16K (4158) - RowGroups rejected: 1 (1) - RowGroups total: 6.25K (6255) - Rows processed: 1.87M (1873374) - Rows rejected: 0 (0) - Rows total: 6.32M (6317238) - Splits processed: 2.00K (1997) - Splits rejected: 1.88K (1882) - Splits total: 2.05K (2050) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1873374) - Rows rejected: 0 (0) - Rows total: 6.32M (6317238) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1873374) - Rows rejected: 0 (0) - Rows total: 6.32M (6317238) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.87M (1873374) - Rows rejected: 0 (0) - Rows total: 6.32M (6317238) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000046 (host=vc1529.foo.com:22000):(Total: 3m40s, non-child: 3m34s, % non-child: 97.31%) Hdfs split stats (:<# splits>/): -1:30/84.31 MB 0:254/649.33 MB 2:256/688.94 MB 4:258/765.05 MB 1:251/641.52 MB 5:236/625.28 MB 7:228/595.52 MB 6:263/687.90 MB 3:270/666.25 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m3s Filter 12 arrival: 3m3s Filter 14 arrival: 3m3s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 21.19 MB, 39.63 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.69 MB, 36.71 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 36.82 MB, 26.98 MB, 19.96 MB, 24.94 MB, 22.67 MB, 25.96 MB, 21.25 MB, 26.32 MB, 18.76 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 45.53 MB (47743813) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.00 GB (1076688547) - RowsProduced: 5.58M (5581635) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m5s - TotalStorageWaitTime: 741.484ms - TotalThreadsInvoluntaryContextSwitches: 1.60K (1603) - TotalThreadsTotalWallClockTime: 7m13s - TotalThreadsSysTime: 938.857ms - TotalThreadsUserTime: 5s135ms - TotalThreadsVoluntaryContextSwitches: 22.57K (22567) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 3s066ms - OpenTime: 189.962ms - ExecTreeOpenTime: 2.915ms - PrepareTime: 390.545ms - ExecTreePrepareTime: 44.314ms KrpcDataStreamSender (dst_id=18):(Total: 2s464ms, non-child: 2s464ms, % non-child: 100.00%) - BytesSent: 126.36 MB (132498267) - OverallThroughput: 51.27 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.58M (5581635) - RpcRetry: 0 (0) - SerializeBatchTime: 2s268ms - UncompressedRowBatchSize: 196.95 MB (206520495) CodeGen:(Total: 326.901ms, non-child: 326.901ms, % non-child: 100.00%) - CodegenTime: 3.358ms - CompileTime: 30.715ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 143.733ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 145.584ms HDFS_SCAN_NODE (id=1):(Total: 3s143ms, non-child: 3s143ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:30/84.31 MB 0:254/649.33 MB 2:256/688.94 MB 4:258/765.05 MB 1:251/641.52 MB 5:236/625.28 MB 7:228/595.52 MB 6:263/687.90 MB 3:270/666.25 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 166 out of 166 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 502ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:166 PARQUET/Unknown(Skipped):1880 BytesRead(4s000ms): 12.84 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 30.76 MB, 31.30 MB, 37.10 MB, 50.63 MB, 65.66 MB, 72.98 MB, 84.49 MB, 107.80 MB, 133.62 MB - FooterProcessingTime: (Avg: 1.528ms ; Min: 329.455us ; Max: 20.343ms ; Number of samples: 166) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 134.84 MB (141389828) - BytesReadDataNodeCache: 0 - BytesReadLocal: 128.74 MB (134989530) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 128.74 MB (134989530) - CachedFileHandlesHitCount: 951 (951) - CachedFileHandlesMissCount: 39 (39) - CollectionItemsRead: 0 (0) - DecompressionTime: 921.872ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 166 (166) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6448901) - PerReadThreadRawHdfsThroughput: 160.75 MB/sec - RemoteScanRanges: 114 (114) - RowBatchQueueGetWaitTime: 2s332ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 5.58M (5581635) - RowsReturned: 5.58M (5581635) - RowsReturnedRate: 1.78 M/sec - ScanRangesComplete: 2.05K (2046) - ScannerThreadsInvoluntaryContextSwitches: 662 (662) - ScannerThreadsTotalWallClockTime: 3m33s - MaterializeTupleTime(*): 18s438ms - ScannerThreadsSysTime: 457.930ms - ScannerThreadsUserTime: 1s846ms - ScannerThreadsVoluntaryContextSwitches: 10.34K (10335) - TotalRawHdfsReadTime(*): 838.832ms - TotalReadThroughput: 639.24 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2012540) - Rows rejected: 0 (0) - Rows total: 5.58M (5581635) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.05K (2046) - RowGroups processed: 4.10K (4097) - RowGroups rejected: 1 (1) - RowGroups total: 5.53K (5532) - Rows processed: 2.01M (2012540) - Rows rejected: 0 (0) - Rows total: 5.58M (5581635) - Splits processed: 2.00K (2004) - Splits rejected: 1.88K (1880) - Splits total: 2.05K (2046) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2012540) - Rows rejected: 0 (0) - Rows total: 5.58M (5581635) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2012540) - Rows rejected: 0 (0) - Rows total: 5.58M (5581635) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.01M (2012540) - Rows rejected: 0 (0) - Rows total: 5.58M (5581635) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000048 (host=vc1519.foo.com:22000):(Total: 3m40s, non-child: 3m31s, % non-child: 96.21%) Hdfs split stats (:<# splits>/): 4:216/529.37 MB -1:41/89.72 MB 0:277/726.64 MB 7:261/675.35 MB 2:255/637.36 MB 5:262/715.57 MB 1:248/712.08 MB 6:257/670.13 MB 3:238/646.57 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 17.78 MB, 33.70 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.57 MB, 47.62 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 47.71 MB, 44.18 MB, 22.82 MB, 24.59 MB, 26.26 MB, 27.02 MB, 23.58 MB, 24.18 MB, 27.34 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.72 MB (50036985) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.01 GB (1081431367) - RowsProduced: 5.49M (5490828) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m5s - TotalStorageWaitTime: 758.247ms - TotalThreadsInvoluntaryContextSwitches: 1.70K (1701) - TotalThreadsTotalWallClockTime: 7m15s - TotalThreadsSysTime: 905.862ms - TotalThreadsUserTime: 5s007ms - TotalThreadsVoluntaryContextSwitches: 22.75K (22755) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 5s719ms - OpenTime: 214.737ms - ExecTreeOpenTime: 2.592ms - PrepareTime: 226.678ms - ExecTreePrepareTime: 33.190ms KrpcDataStreamSender (dst_id=18):(Total: 2s276ms, non-child: 2s276ms, % non-child: 100.00%) - BytesSent: 124.21 MB (130241933) - OverallThroughput: 54.57 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.49M (5490828) - RpcRetry: 0 (0) - SerializeBatchTime: 2s163ms - UncompressedRowBatchSize: 193.75 MB (203160636) CodeGen:(Total: 286.469ms, non-child: 286.469ms, % non-child: 100.00%) - CodegenTime: 2.347ms - CompileTime: 63.011ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 140.206ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 78.895ms HDFS_SCAN_NODE (id=1):(Total: 5s774ms, non-child: 5s774ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:216/529.37 MB -1:41/89.72 MB 0:277/726.64 MB 7:261/675.35 MB 2:255/637.36 MB 5:262/715.57 MB 1:248/712.08 MB 6:257/670.13 MB 3:238/646.57 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 157 out of 157 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 642ms Hdfs Read Thread Concurrency Bucket: 0:99.77% 1:0.2326% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:157 PARQUET/Unknown(Skipped):1898 BytesRead(4s000ms): 5.99 MB, 25.79 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 30.22 MB, 31.01 MB, 34.05 MB, 46.28 MB, 58.43 MB, 69.70 MB, 88.13 MB, 115.56 MB - FooterProcessingTime: (Avg: 2.103ms ; Min: 300.438us ; Max: 71.094ms ; Number of samples: 157) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 131.25 MB (137625400) - BytesReadDataNodeCache: 0 - BytesReadLocal: 127.22 MB (133399472) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 127.22 MB (133399472) - CachedFileHandlesHitCount: 901 (901) - CachedFileHandlesMissCount: 28 (28) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s071ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 157 (157) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.15 MB (6445294) - PerReadThreadRawHdfsThroughput: 160.77 MB/sec - RemoteScanRanges: 84 (84) - RowBatchQueueGetWaitTime: 4s556ms - RowBatchQueuePutWaitTime: 3m3s - RowsRead: 5.49M (5490828) - RowsReturned: 5.49M (5490828) - RowsReturnedRate: 950.86 K/sec - ScanRangesComplete: 2.06K (2055) - ScannerThreadsInvoluntaryContextSwitches: 698 (698) - ScannerThreadsTotalWallClockTime: 3m35s - MaterializeTupleTime(*): 21s822ms - ScannerThreadsSysTime: 411.937ms - ScannerThreadsUserTime: 1s802ms - ScannerThreadsVoluntaryContextSwitches: 10.84K (10840) - TotalRawHdfsReadTime(*): 816.364ms - TotalReadThroughput: 623.20 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1939301) - Rows rejected: 0 (0) - Rows total: 5.49M (5490828) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2055) - RowGroups processed: 4.02K (4017) - RowGroups rejected: 1 (1) - RowGroups total: 5.44K (5443) - Rows processed: 1.94M (1939301) - Rows rejected: 0 (0) - Rows total: 5.49M (5490828) - Splits processed: 2.02K (2019) - Splits rejected: 1.90K (1898) - Splits total: 2.06K (2055) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1939301) - Rows rejected: 0 (0) - Rows total: 5.49M (5490828) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1939301) - Rows rejected: 0 (0) - Rows total: 5.49M (5490828) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1939301) - Rows rejected: 0 (0) - Rows total: 5.49M (5490828) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000044 (host=vc1503.foo.com:22000):(Total: 3m40s, non-child: 3m35s, % non-child: 98.08%) Hdfs split stats (:<# splits>/): 6:239/608.43 MB 3:237/626.76 MB 4:254/666.38 MB 1:264/693.67 MB 7:260/711.52 MB 2:237/609.19 MB -1:36/89.46 MB 0:245/656.84 MB 5:225/742.78 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m1s Filter 14 arrival: 3m1s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s MemoryUsage(4s000ms): 20.14 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.40 MB, 21.47 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 21.53 MB, 19.56 MB, 23.76 MB, 25.41 MB, 18.10 MB, 20.15 MB, 13.79 MB, 10.96 MB, 9.12 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 46.01 MB (48249341) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.00 GB (1074038560) - RowsProduced: 5.56M (5559173) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m21s - TotalStorageWaitTime: 626.701ms - TotalThreadsInvoluntaryContextSwitches: 1.39K (1388) - TotalThreadsTotalWallClockTime: 7m3s - TotalThreadsSysTime: 784.880ms - TotalThreadsUserTime: 4s444ms - TotalThreadsVoluntaryContextSwitches: 18.30K (18302) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 2s470ms - OpenTime: 153.298ms - ExecTreeOpenTime: 2.844ms - PrepareTime: 264.132ms - ExecTreePrepareTime: 46.549ms KrpcDataStreamSender (dst_id=18):(Total: 1s442ms, non-child: 1s442ms, % non-child: 100.00%) - BytesSent: 125.85 MB (131967613) - OverallThroughput: 87.24 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.56M (5559173) - RpcRetry: 0 (0) - SerializeBatchTime: 1s306ms - UncompressedRowBatchSize: 196.16 MB (205689401) CodeGen:(Total: 228.256ms, non-child: 228.256ms, % non-child: 100.00%) - CodegenTime: 9.382ms - CompileTime: 31.469ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 111.002ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 78.495ms HDFS_SCAN_NODE (id=1):(Total: 2s556ms, non-child: 2s556ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:239/608.43 MB 3:237/626.76 MB 4:254/666.38 MB 1:264/693.67 MB 7:260/711.52 MB 2:237/609.19 MB -1:36/89.46 MB 0:245/656.84 MB 5:225/742.78 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 163 out of 163 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 682ms Hdfs Read Thread Concurrency Bucket: 0:99.51% 1:0.4914% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:163 PARQUET/Unknown(Skipped):1834 BytesRead(4s000ms): 16.34 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 30.39 MB, 31.16 MB, 44.18 MB, 65.47 MB, 81.06 MB, 111.45 MB - FooterProcessingTime: (Avg: 1.242ms ; Min: 216.848us ; Max: 12.215ms ; Number of samples: 163) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 129.16 MB (135439073) - BytesReadDataNodeCache: 0 - BytesReadLocal: 124.85 MB (130913091) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 124.85 MB (130913091) - CachedFileHandlesHitCount: 889 (889) - CachedFileHandlesMissCount: 32 (32) - CollectionItemsRead: 0 (0) - DecompressionTime: 736.088ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 163 (163) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.20 MB (6501591) - PerReadThreadRawHdfsThroughput: 171.17 MB/sec - RemoteScanRanges: 96 (96) - RowBatchQueueGetWaitTime: 1s649ms - RowBatchQueuePutWaitTime: 3m7s - RowsRead: 5.56M (5559173) - RowsReturned: 5.56M (5559173) - RowsReturnedRate: 2.17 M/sec - ScanRangesComplete: 2.00K (1997) - ScannerThreadsInvoluntaryContextSwitches: 623 (623) - ScannerThreadsTotalWallClockTime: 3m24s - MaterializeTupleTime(*): 10s071ms - ScannerThreadsSysTime: 390.940ms - ScannerThreadsUserTime: 1s617ms - ScannerThreadsVoluntaryContextSwitches: 8.35K (8346) - TotalRawHdfsReadTime(*): 754.593ms - TotalReadThroughput: 640.55 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2003984) - Rows rejected: 0 (0) - Rows total: 5.56M (5559173) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.00K (1997) - RowGroups processed: 4.06K (4061) - RowGroups rejected: 1 (1) - RowGroups total: 5.50K (5505) - Rows processed: 2.00M (2003984) - Rows rejected: 0 (0) - Rows total: 5.56M (5559173) - Splits processed: 1.96K (1958) - Splits rejected: 1.83K (1834) - Splits total: 2.00K (1997) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2003984) - Rows rejected: 0 (0) - Rows total: 5.56M (5559173) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2003984) - Rows rejected: 0 (0) - Rows total: 5.56M (5559173) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.00M (2003984) - Rows rejected: 0 (0) - Rows total: 5.56M (5559173) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000033 (host=vc1522.foo.com:22000):(Total: 3m40s, non-child: 3m33s, % non-child: 96.89%) Hdfs split stats (:<# splits>/): 6:249/660.99 MB 5:272/691.17 MB 7:270/673.74 MB 2:290/751.43 MB 3:256/659.75 MB -1:34/87.56 MB 0:257/635.99 MB 1:256/650.09 MB 4:239/593.06 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 24.16 MB, 30.80 MB, 28.40 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.35 MB, 47.38 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 47.48 MB, 40.23 MB, 21.54 MB, 25.91 MB, 26.66 MB, 28.05 MB, 16.48 MB, 8.00 MB, 7.75 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.48 MB (49786324) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1002.79 MB (1051506410) - RowsProduced: 6.04M (6043050) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m13s - TotalStorageWaitTime: 758.822ms - TotalThreadsInvoluntaryContextSwitches: 1.66K (1663) - TotalThreadsTotalWallClockTime: 7m5s - TotalThreadsSysTime: 928.858ms - TotalThreadsUserTime: 5s165ms - TotalThreadsVoluntaryContextSwitches: 21.56K (21557) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 3s873ms - OpenTime: 221.528ms - ExecTreeOpenTime: 3.182ms - PrepareTime: 243.290ms - ExecTreePrepareTime: 28.918ms KrpcDataStreamSender (dst_id=18):(Total: 2s595ms, non-child: 2s595ms, % non-child: 100.00%) - BytesSent: 136.73 MB (143372203) - OverallThroughput: 52.68 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.04M (6043050) - RpcRetry: 0 (0) - SerializeBatchTime: 2s488ms - UncompressedRowBatchSize: 213.23 MB (223592850) CodeGen:(Total: 322.427ms, non-child: 322.427ms, % non-child: 100.00%) - CodegenTime: 3.874ms - CompileTime: 33.052ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 179.195ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 108.534ms HDFS_SCAN_NODE (id=1):(Total: 3s922ms, non-child: 3s922ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:249/660.99 MB 5:272/691.17 MB 7:270/673.74 MB 2:290/751.43 MB 3:256/659.75 MB -1:34/87.56 MB 0:257/635.99 MB 1:256/650.09 MB 4:239/593.06 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 174 out of 174 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 622ms Hdfs Read Thread Concurrency Bucket: 0:99.76% 1:0.2433% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:174 PARQUET/Unknown(Skipped):1949 BytesRead(4s000ms): 14.16 MB, 30.94 MB, 37.52 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.47 MB, 43.86 MB, 47.02 MB, 65.11 MB, 102.75 MB, 122.87 MB - FooterProcessingTime: (Avg: 1.307ms ; Min: 424.608us ; Max: 12.900ms ; Number of samples: 174) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 144.21 MB (151219564) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.21 MB (144924864) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.21 MB (144924864) - CachedFileHandlesHitCount: 1.00K (1000) - CachedFileHandlesMissCount: 36 (36) - CollectionItemsRead: 0 (0) - DecompressionTime: 986.509ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 174 (174) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.22 MB (6524618) - PerReadThreadRawHdfsThroughput: 166.45 MB/sec - RemoteScanRanges: 108 (108) - RowBatchQueueGetWaitTime: 3s098ms - RowBatchQueuePutWaitTime: 3m4s - RowsRead: 6.04M (6043050) - RowsReturned: 6.04M (6043050) - RowsReturnedRate: 1.54 M/sec - ScanRangesComplete: 2.12K (2123) - ScannerThreadsInvoluntaryContextSwitches: 719 (719) - ScannerThreadsTotalWallClockTime: 3m25s - MaterializeTupleTime(*): 13s378ms - ScannerThreadsSysTime: 457.930ms - ScannerThreadsUserTime: 1s814ms - ScannerThreadsVoluntaryContextSwitches: 10.06K (10064) - TotalRawHdfsReadTime(*): 866.401ms - TotalReadThroughput: 715.40 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1926942) - Rows rejected: 0 (0) - Rows total: 6.04M (6043050) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.12K (2123) - RowGroups processed: 3.90K (3899) - RowGroups rejected: 0 (0) - RowGroups total: 5.98K (5983) - Rows processed: 1.93M (1926942) - Rows rejected: 0 (0) - Rows total: 6.04M (6043050) - Splits processed: 2.07K (2068) - Splits rejected: 1.95K (1949) - Splits total: 2.12K (2123) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1926942) - Rows rejected: 0 (0) - Rows total: 6.04M (6043050) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1926942) - Rows rejected: 0 (0) - Rows total: 6.04M (6043050) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.93M (1926942) - Rows rejected: 0 (0) - Rows total: 6.04M (6043050) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:327003730000004a (host=vc1528.foo.com:22000):(Total: 3m39s, non-child: 3m34s, % non-child: 97.85%) Hdfs split stats (:<# splits>/): 6:244/604.04 MB -1:38/86.88 MB 0:246/647.33 MB 1:282/829.14 MB 4:269/680.91 MB 5:268/709.07 MB 2:230/557.28 MB 7:245/649.82 MB 3:247/637.45 MB Filter 10 arrival: 1m1s Filter 8 arrival: 1m3s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s Filter 13 arrival: 3m3s MemoryUsage(4s000ms): 28.84 MB, 43.31 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.99 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 48.09 MB, 43.64 MB, 22.04 MB, 23.65 MB, 15.92 MB, 27.19 MB, 16.59 MB, 7.24 MB, 6.72 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.09 MB (50425169) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1014.81 MB (1064106146) - RowsProduced: 6.09M (6090576) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m17s - TotalStorageWaitTime: 905.686ms - TotalThreadsInvoluntaryContextSwitches: 1.53K (1530) - TotalThreadsTotalWallClockTime: 7m5s - TotalThreadsSysTime: 850.869ms - TotalThreadsUserTime: 4s902ms - TotalThreadsVoluntaryContextSwitches: 18.60K (18602) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 2s947ms - OpenTime: 129.845ms - ExecTreeOpenTime: 2.265ms - PrepareTime: 154.596ms - ExecTreePrepareTime: 23.700ms KrpcDataStreamSender (dst_id=18):(Total: 1s547ms, non-child: 1s547ms, % non-child: 100.00%) - BytesSent: 137.82 MB (144515304) - OverallThroughput: 89.05 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.09M (6090576) - RpcRetry: 0 (0) - SerializeBatchTime: 1s486ms - UncompressedRowBatchSize: 214.91 MB (225351312) CodeGen:(Total: 193.480ms, non-child: 193.480ms, % non-child: 100.00%) - CodegenTime: 4.034ms - CompileTime: 26.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 98.340ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 61.716ms HDFS_SCAN_NODE (id=1):(Total: 2s985ms, non-child: 2s985ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:244/604.04 MB -1:38/86.88 MB 0:246/647.33 MB 1:282/829.14 MB 4:269/680.91 MB 5:268/709.07 MB 2:230/557.28 MB 7:245/649.82 MB 3:247/637.45 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 177 out of 177 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 803ms Hdfs Read Thread Concurrency Bucket: 0:99.76% 1:0.2439% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:177 PARQUET/Unknown(Skipped):1892 BytesRead(4s000ms): 16.38 MB, 40.51 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.00 MB, 44.20 MB, 51.97 MB, 74.14 MB, 81.16 MB, 105.27 MB - FooterProcessingTime: (Avg: 2.155ms ; Min: 377.715us ; Max: 41.363ms ; Number of samples: 177) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 145.82 MB (152899191) - BytesReadDataNodeCache: 0 - BytesReadLocal: 139.06 MB (145813277) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 139.06 MB (145813277) - CachedFileHandlesHitCount: 1.01K (1006) - CachedFileHandlesMissCount: 43 (43) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s203ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 177 (177) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.17 MB (6467931) - PerReadThreadRawHdfsThroughput: 153.81 MB/sec - RemoteScanRanges: 129 (129) - RowBatchQueueGetWaitTime: 1s959ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 6.09M (6090576) - RowsReturned: 6.09M (6090576) - RowsReturnedRate: 2.04 M/sec - ScanRangesComplete: 2.07K (2069) - ScannerThreadsInvoluntaryContextSwitches: 662 (662) - ScannerThreadsTotalWallClockTime: 3m25s - MaterializeTupleTime(*): 12s429ms - ScannerThreadsSysTime: 421.935ms - ScannerThreadsUserTime: 1s766ms - ScannerThreadsVoluntaryContextSwitches: 8.69K (8687) - TotalRawHdfsReadTime(*): 948.046ms - TotalReadThroughput: 716.40 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1938483) - Rows rejected: 0 (0) - Rows total: 6.09M (6090576) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.07K (2069) - RowGroups processed: 3.96K (3955) - RowGroups rejected: 1 (1) - RowGroups total: 6.03K (6034) - Rows processed: 1.94M (1938483) - Rows rejected: 0 (0) - Rows total: 6.09M (6090576) - Splits processed: 2.01K (2013) - Splits rejected: 1.89K (1892) - Splits total: 2.07K (2069) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1938483) - Rows rejected: 0 (0) - Rows total: 6.09M (6090576) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1938483) - Rows rejected: 0 (0) - Rows total: 6.09M (6090576) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.94M (1938483) - Rows rejected: 0 (0) - Rows total: 6.09M (6090576) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000049 (host=vc1510.foo.com:22000):(Total: 3m39s, non-child: 3m35s, % non-child: 98.24%) Hdfs split stats (:<# splits>/): 7:266/679.32 MB 3:245/609.97 MB 2:242/660.82 MB 5:261/666.14 MB 4:255/712.97 MB -1:35/89.38 MB 0:266/701.16 MB 6:237/620.53 MB 1:252/663.74 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 47.04 MB, 63.71 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.00 MB, 62.09 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 62.14 MB, 61.76 MB, 50.01 MB, 34.33 MB, 24.62 MB, 24.79 MB, 16.50 MB, 12.32 MB, 10.29 MB, 8.81 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 78.71 MB (82538386) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 985.93 MB (1033823998) - RowsProduced: 6.25M (6249479) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m24s - TotalStorageWaitTime: 578.587ms - TotalThreadsInvoluntaryContextSwitches: 1.38K (1384) - TotalThreadsTotalWallClockTime: 7m1s - TotalThreadsSysTime: 805.877ms - TotalThreadsUserTime: 4s620ms - TotalThreadsVoluntaryContextSwitches: 17.70K (17696) Fragment Instance Lifecycle Timings: - ExecTime: 3m39s - ExecTreeExecTime: 2s325ms - OpenTime: 95.305ms - ExecTreeOpenTime: 2.468ms - PrepareTime: 134.472ms - ExecTreePrepareTime: 22.225ms KrpcDataStreamSender (dst_id=18):(Total: 1s347ms, non-child: 1s347ms, % non-child: 100.00%) - BytesSent: 136.83 MB (143474908) - OverallThroughput: 101.58 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.25M (6249479) - RpcRetry: 0 (0) - SerializeBatchTime: 1s293ms - UncompressedRowBatchSize: 220.52 MB (231230723) CodeGen:(Total: 149.714ms, non-child: 149.714ms, % non-child: 100.00%) - CodegenTime: 2.031ms - CompileTime: 23.421ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 67.621ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 57.367ms HDFS_SCAN_NODE (id=1):(Total: 2s362ms, non-child: 2s362ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:266/679.32 MB 3:245/609.97 MB 2:242/660.82 MB 5:261/666.14 MB 4:255/712.97 MB -1:35/89.38 MB 0:266/701.16 MB 6:237/620.53 MB 1:252/663.74 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 138 out of 138 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 864ms Hdfs Read Thread Concurrency Bucket: 0:99.75% 1:0.2488% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:138 PARQUET/Unknown(Skipped):1921 BytesRead(4s000ms): 23.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 35.44 MB, 38.02 MB, 66.26 MB, 86.20 MB, 112.80 MB - FooterProcessingTime: (Avg: 1.424ms ; Min: 405.126us ; Max: 21.888ms ; Number of samples: 138) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 140.83 MB (147670007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 138.02 MB (144723672) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 138.02 MB (144723672) - CachedFileHandlesHitCount: 841 (841) - CachedFileHandlesMissCount: 23 (23) - CollectionItemsRead: 0 (0) - DecompressionTime: 487.687ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 138 (138) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 36.76 MB (38541478) - PerReadThreadRawHdfsThroughput: 184.42 MB/sec - RemoteScanRanges: 69 (69) - RowBatchQueueGetWaitTime: 1s256ms - RowBatchQueuePutWaitTime: 3m9s - RowsRead: 6.25M (6249479) - RowsReturned: 6.25M (6249479) - RowsReturnedRate: 2.65 M/sec - ScanRangesComplete: 2.06K (2059) - ScannerThreadsInvoluntaryContextSwitches: 620 (620) - ScannerThreadsTotalWallClockTime: 3m21s - MaterializeTupleTime(*): 8s213ms - ScannerThreadsSysTime: 391.940ms - ScannerThreadsUserTime: 1s693ms - ScannerThreadsVoluntaryContextSwitches: 8.14K (8136) - TotalRawHdfsReadTime(*): 763.645ms - TotalReadThroughput: 701.25 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1989466) - Rows rejected: 0 (0) - Rows total: 6.25M (6249479) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2059) - RowGroups processed: 4.08K (4085) - RowGroups rejected: 1 (1) - RowGroups total: 6.17K (6171) - Rows processed: 1.99M (1989466) - Rows rejected: 0 (0) - Rows total: 6.25M (6249479) - Splits processed: 2.04K (2045) - Splits rejected: 1.92K (1921) - Splits total: 2.06K (2059) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1989466) - Rows rejected: 0 (0) - Rows total: 6.25M (6249479) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1989466) - Rows rejected: 0 (0) - Rows total: 6.25M (6249479) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.99M (1989466) - Rows rejected: 0 (0) - Rows total: 6.25M (6249479) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000043 (host=vc1518.foo.com:22000):(Total: 3m39s, non-child: 3m33s, % non-child: 97.22%) Hdfs split stats (:<# splits>/): 2:240/614.24 MB 3:235/592.61 MB 7:266/713.90 MB 6:250/736.40 MB 4:258/683.01 MB 5:255/687.63 MB -1:35/157.66 MB 0:264/663.08 MB 1:235/622.30 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 13 arrival: 3m1s Filter 12 arrival: 3m2s Filter 14 arrival: 3m2s MemoryUsage(4s000ms): 26.59 MB, 34.55 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.37 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.45 MB, 43.32 MB, 39.70 MB, 24.32 MB, 26.42 MB, 22.71 MB, 25.01 MB, 25.20 MB, 19.00 MB, 9.58 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 48.13 MB (50472635) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1.02 GB (1090252862) - RowsProduced: 6.23M (6227022) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m14s - TotalStorageWaitTime: 1s158ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1587) - TotalThreadsTotalWallClockTime: 7m9s - TotalThreadsSysTime: 932.857ms - TotalThreadsUserTime: 5s042ms - TotalThreadsVoluntaryContextSwitches: 21.07K (21069) Fragment Instance Lifecycle Timings: - ExecTime: 3m38s - ExecTreeExecTime: 4s023ms - OpenTime: 119.325ms - ExecTreeOpenTime: 2.581ms - PrepareTime: 161.316ms - ExecTreePrepareTime: 25.555ms KrpcDataStreamSender (dst_id=18):(Total: 1s880ms, non-child: 1s880ms, % non-child: 100.00%) - BytesSent: 140.90 MB (147741398) - OverallThroughput: 74.95 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.23M (6227022) - RpcRetry: 0 (0) - SerializeBatchTime: 1s791ms - UncompressedRowBatchSize: 219.73 MB (230399814) CodeGen:(Total: 157.941ms, non-child: 157.941ms, % non-child: 100.00%) - CodegenTime: 2.362ms - CompileTime: 25.737ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 84.247ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 46.546ms HDFS_SCAN_NODE (id=1):(Total: 4s065ms, non-child: 4s065ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:240/614.24 MB 3:235/592.61 MB 7:266/713.90 MB 6:250/736.40 MB 4:258/683.01 MB 5:255/687.63 MB -1:35/157.66 MB 0:264/663.08 MB 1:235/622.30 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 178 out of 178 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 803ms Hdfs Read Thread Concurrency Bucket: 0:99.76% 1:0.2375% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:178 PARQUET/Unknown(Skipped):1860 BytesRead(4s000ms): 19.57 MB, 40.67 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 44.81 MB, 45.27 MB, 46.40 MB, 58.84 MB, 86.18 MB, 103.53 MB, 114.95 MB - FooterProcessingTime: (Avg: 2.090ms ; Min: 331.296us ; Max: 78.352ms ; Number of samples: 178) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 145.63 MB (152700274) - BytesReadDataNodeCache: 0 - BytesReadLocal: 140.93 MB (147775776) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 140.93 MB (147775776) - CachedFileHandlesHitCount: 989 (989) - CachedFileHandlesMissCount: 36 (36) - CollectionItemsRead: 0 (0) - DecompressionTime: 753.517ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 178 (178) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.14 MB (6436100) - PerReadThreadRawHdfsThroughput: 139.40 MB/sec - RemoteScanRanges: 108 (108) - RowBatchQueueGetWaitTime: 3s082ms - RowBatchQueuePutWaitTime: 3m8s - RowsRead: 6.23M (6227022) - RowsReturned: 6.23M (6227022) - RowsReturnedRate: 1.53 M/sec - ScanRangesComplete: 2.04K (2038) - ScannerThreadsInvoluntaryContextSwitches: 696 (696) - ScannerThreadsTotalWallClockTime: 3m30s - MaterializeTupleTime(*): 14s828ms - ScannerThreadsSysTime: 486.925ms - ScannerThreadsUserTime: 1s780ms - ScannerThreadsVoluntaryContextSwitches: 10.01K (10010) - TotalRawHdfsReadTime(*): 1s044ms - TotalReadThroughput: 696.55 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1914894) - Rows rejected: 0 (0) - Rows total: 6.23M (6227022) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.04K (2038) - RowGroups processed: 4.08K (4077) - RowGroups rejected: 1 (1) - RowGroups total: 6.17K (6168) - Rows processed: 1.91M (1914894) - Rows rejected: 0 (0) - Rows total: 6.23M (6227022) - Splits processed: 1.98K (1978) - Splits rejected: 1.86K (1860) - Splits total: 2.04K (2038) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1914894) - Rows rejected: 0 (0) - Rows total: 6.23M (6227022) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1914894) - Rows rejected: 0 (0) - Rows total: 6.23M (6227022) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.91M (1914894) - Rows rejected: 0 (0) - Rows total: 6.23M (6227022) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000027 (host=vc1534.foo.com:22000):(Total: 3m38s, non-child: 3m29s, % non-child: 95.72%) Hdfs split stats (:<# splits>/): 4:241/621.37 MB 7:252/648.42 MB 2:223/582.29 MB 5:259/662.07 MB 3:289/729.90 MB -1:34/89.78 MB 0:242/603.25 MB 1:241/614.78 MB 6:279/851.95 MB Filter 10 arrival: 1m Filter 8 arrival: 1m2s Filter 12 arrival: 3m1s Filter 14 arrival: 3m2s Filter 13 arrival: 3m2s MemoryUsage(4s000ms): 5.87 MB, 24.64 MB, 37.72 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.06 MB, 47.13 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 47.20 MB, 37.90 MB, 18.52 MB, 23.97 MB, 24.36 MB, 26.88 MB, 24.15 MB, 25.43 MB, 8.28 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.20 MB (49488186) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 1019.31 MB (1068824164) - RowsProduced: 5.44M (5442260) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m1s - TotalStorageWaitTime: 719.382ms - TotalThreadsInvoluntaryContextSwitches: 1.76K (1758) - TotalThreadsTotalWallClockTime: 7m7s - TotalThreadsSysTime: 949.856ms - TotalThreadsUserTime: 5s019ms - TotalThreadsVoluntaryContextSwitches: 22.57K (22570) Fragment Instance Lifecycle Timings: - ExecTime: 3m36s - ExecTreeExecTime: 3s314ms - OpenTime: 199.664ms - ExecTreeOpenTime: 2.555ms - PrepareTime: 2s077ms - ExecTreePrepareTime: 446.462ms KrpcDataStreamSender (dst_id=18):(Total: 4s586ms, non-child: 4s586ms, % non-child: 100.00%) - BytesSent: 123.11 MB (129092727) - OverallThroughput: 26.84 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 5.44M (5442260) - RpcRetry: 0 (0) - SerializeBatchTime: 3s339ms - UncompressedRowBatchSize: 192.04 MB (201363620) CodeGen:(Total: 575.080ms, non-child: 575.080ms, % non-child: 100.00%) - CodegenTime: 4.763ms - CompileTime: 50.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 140.359ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 353.947ms HDFS_SCAN_NODE (id=1):(Total: 4s199ms, non-child: 4s199ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:241/621.37 MB 7:252/648.42 MB 2:223/582.29 MB 5:259/662.07 MB 3:289/729.90 MB -1:34/89.78 MB 0:242/603.25 MB 1:241/614.78 MB 6:279/851.95 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 101ms Hdfs Read Thread Concurrency Bucket: 0:99.52% 1:0.4762% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:165 PARQUET/Unknown(Skipped):1895 BytesRead(4s000ms): 956.44 KB, 13.24 MB, 27.88 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 30.80 MB, 31.57 MB, 34.82 MB, 50.09 MB, 69.59 MB, 77.95 MB, 91.76 MB, 117.56 MB - FooterProcessingTime: (Avg: 1.373ms ; Min: 315.196us ; Max: 12.101ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 130.91 MB (137269315) - BytesReadDataNodeCache: 0 - BytesReadLocal: 125.08 MB (131160337) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 125.08 MB (131160337) - CachedFileHandlesHitCount: 928 (928) - CachedFileHandlesMissCount: 36 (36) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s309ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.12 MB (6412829) - PerReadThreadRawHdfsThroughput: 168.28 MB/sec - RemoteScanRanges: 108 (108) - RowBatchQueueGetWaitTime: 2s789ms - RowBatchQueuePutWaitTime: 2m59s - RowsRead: 5.44M (5442260) - RowsReturned: 5.44M (5442260) - RowsReturnedRate: 1.30 M/sec - ScanRangesComplete: 2.06K (2060) - ScannerThreadsInvoluntaryContextSwitches: 735 (735) - ScannerThreadsTotalWallClockTime: 3m30s - MaterializeTupleTime(*): 21s083ms - ScannerThreadsSysTime: 446.932ms - ScannerThreadsUserTime: 1s825ms - ScannerThreadsVoluntaryContextSwitches: 10.53K (10529) - TotalRawHdfsReadTime(*): 777.942ms - TotalReadThroughput: 632.32 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1980455) - Rows rejected: 0 (0) - Rows total: 5.44M (5442260) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2060) - RowGroups processed: 3.98K (3975) - RowGroups rejected: 1 (1) - RowGroups total: 5.40K (5400) - Rows processed: 1.98M (1980455) - Rows rejected: 0 (0) - Rows total: 5.44M (5442260) - Splits processed: 2.02K (2018) - Splits rejected: 1.90K (1895) - Splits total: 2.06K (2060) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1980455) - Rows rejected: 0 (0) - Rows total: 5.44M (5442260) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1980455) - Rows rejected: 0 (0) - Rows total: 5.44M (5442260) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 1.98M (1980455) - Rows rejected: 0 (0) - Rows total: 5.44M (5442260) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Instance b04615c310d227c4:3270037300000040 (host=vc1505.foo.com:22000):(Total: 3m30s, non-child: 3m25s, % non-child: 97.42%) Hdfs split stats (:<# splits>/): 7:239/682.56 MB 2:264/675.17 MB 1:230/601.83 MB -1:36/85.81 MB 0:250/651.16 MB 3:251/662.41 MB 6:277/715.67 MB 4:252/676.54 MB 5:260/650.97 MB Filter 10 arrival: 1m2s Filter 8 arrival: 1m2s Filter 14 arrival: 3m1s Filter 13 arrival: 3m1s Filter 12 arrival: 3m1s MemoryUsage(4s000ms): 20.07 MB, 40.68 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.83 MB, 47.90 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 47.96 MB, 42.22 MB, 24.44 MB, 28.20 MB, 26.26 MB, 19.30 MB, 11.10 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 136.00 KB (139264) - PeakMemoryUsage: 47.96 MB (50293108) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 988.82 MB (1036853717) - RowsProduced: 6.30M (6302156) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3m11s - TotalStorageWaitTime: 790.397ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1588) - TotalThreadsTotalWallClockTime: 6m51s - TotalThreadsSysTime: 834.872ms - TotalThreadsUserTime: 5s239ms - TotalThreadsVoluntaryContextSwitches: 18.95K (18948) Fragment Instance Lifecycle Timings: - ExecTime: 3m30s - ExecTreeExecTime: 3s387ms - OpenTime: 136.613ms - ExecTreeOpenTime: 3.338ms - PrepareTime: 224.587ms - ExecTreePrepareTime: 30.863ms KrpcDataStreamSender (dst_id=18):(Total: 1s775ms, non-child: 1s775ms, % non-child: 100.00%) - BytesSent: 142.68 MB (149606618) - OverallThroughput: 80.36 MB/sec - PeakMemoryUsage: 41.96 MB (43996848) - RowsReturned: 6.30M (6302156) - RpcRetry: 0 (0) - SerializeBatchTime: 1s669ms - UncompressedRowBatchSize: 222.38 MB (233179772) CodeGen:(Total: 215.091ms, non-child: 215.091ms, % non-child: 100.00%) - CodegenTime: 3.528ms - CompileTime: 52.156ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 40 (40) - NumInstructions: 735 (735) - OptimizationTime: 76.544ms - PeakMemoryUsage: 367.50 KB (376320) - PrepareTime: 76.710ms HDFS_SCAN_NODE (id=1):(Total: 3s440ms, non-child: 3s440ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:239/682.56 MB 2:264/675.17 MB 1:230/601.83 MB -1:36/85.81 MB 0:250/651.16 MB 3:251/662.41 MB 6:277/715.67 MB 4:252/676.54 MB 5:260/650.97 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 184 out of 184 Runtime filters: Not all filters arrived (arrived: [], missing [8, 10, 12, 13, 14]), waited for 723ms Hdfs Read Thread Concurrency Bucket: 0:99.25% 1:0.7463% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:184 PARQUET/Unknown(Skipped):1875 BytesRead(4s000ms): 15.84 MB, 39.10 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 44.65 MB, 45.61 MB, 60.51 MB, 95.68 MB, 126.75 MB - FooterProcessingTime: (Avg: 1.685ms ; Min: 345.506us ; Max: 34.642ms ; Number of samples: 184) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 147.99 MB (155179442) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.16 MB (148014294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.16 MB (148014294) - CachedFileHandlesHitCount: 1.01K (1007) - CachedFileHandlesMissCount: 44 (44) - CollectionItemsRead: 0 (0) - DecompressionTime: 463.586ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 184 (184) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 6.10 MB (6395334) - PerReadThreadRawHdfsThroughput: 166.29 MB/sec - RemoteScanRanges: 132 (132) - RowBatchQueueGetWaitTime: 2s542ms - RowBatchQueuePutWaitTime: 3m5s - RowsRead: 6.30M (6302156) - RowsReturned: 6.30M (6302156) - RowsReturnedRate: 1.83 M/sec - ScanRangesComplete: 2.06K (2059) - ScannerThreadsInvoluntaryContextSwitches: 691 (691) - ScannerThreadsTotalWallClockTime: 3m21s - MaterializeTupleTime(*): 10s531ms - ScannerThreadsSysTime: 435.933ms - ScannerThreadsUserTime: 1s885ms - ScannerThreadsVoluntaryContextSwitches: 8.74K (8745) - TotalRawHdfsReadTime(*): 889.949ms - TotalReadThroughput: 734.31 KB/sec Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2024232) - Rows rejected: 0 (0) - Rows total: 6.30M (6302156) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 10 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 2.06K (2059) - RowGroups processed: 4.17K (4172) - RowGroups rejected: 1 (1) - RowGroups total: 6.25K (6247) - Rows processed: 2.02M (2024232) - Rows rejected: 0 (0) - Rows total: 6.30M (6302156) - Splits processed: 2.00K (2002) - Splits rejected: 1.88K (1875) - Splits total: 2.06K (2059) Filter 12 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2024232) - Rows rejected: 0 (0) - Rows total: 6.30M (6302156) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 13 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2024232) - Rows rejected: 0 (0) - Rows total: 6.30M (6302156) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 14 (1.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 2.02M (2024232) - Rows rejected: 0 (0) - Rows total: 6.30M (6302156) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Averaged Fragment F02:(Total: 2m11s, non-child: 2m1s, % non-child: 91.95%) split sizes: min: 39.53 GB, max: 39.76 GB, avg: 39.57 GB, stddev: 59.25 MB completion times: min:1m34s max:3m7s mean: 2m11s stddev:24s445ms execution rates: min:216.00 MB/sec max:429.79 MB/sec mean:317.71 MB/sec stddev:57.90 MB/sec num instances: 37 - AverageThreadTokens: 1.86 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.81 MB (58517143) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 704.45 MB (738674249) - RowsProduced: 7.03M (7027859) - TotalNetworkReceiveTime: 3s650ms - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 642.948ms - TotalThreadsInvoluntaryContextSwitches: 2.14K (2141) - TotalThreadsTotalWallClockTime: 4m4s - TotalThreadsSysTime: 1s109ms - TotalThreadsUserTime: 7s515ms - TotalThreadsVoluntaryContextSwitches: 24.95K (24953) Fragment Instance Lifecycle Timings: - ExecTime: 2m6s - ExecTreeExecTime: 1s461ms - OpenTime: 4s465ms - ExecTreeOpenTime: 3s945ms - PrepareTime: 918.490ms - ExecTreePrepareTime: 98.944ms KrpcDataStreamSender (dst_id=19):(Total: 4s256ms, non-child: 4s256ms, % non-child: 100.00%) - BytesSent: 200.47 MB (210207034) - OverallThroughput: 52.60 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.03M (7027859) - RpcRetry: 0 (0) - SerializeBatchTime: 3s708ms - UncompressedRowBatchSize: 415.54 MB (435727309) CodeGen:(Total: 757.054ms, non-child: 757.054ms, % non-child: 100.00%) - CodegenTime: 2.842ms - CompileTime: 170.723ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 330.838ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 244.542ms HASH_JOIN_NODE (id=8):(Total: 5s586ms, non-child: 496.198ms, % non-child: 8.88%) - BuildRows: 30 (30) - BuildTime: 36.081ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.03M (7027859) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 420.433ms - RowsReturned: 7.03M (7027859) - RowsReturnedRate: 1.83 M/sec Buffer pool: - AllocTime: 34.660ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): - BuildRowsPartitionTime: 34.321ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.434ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 3s650ms, non-child: 3s650ms, % non-child: 100.00%) - ConvertRowBatchTime: 2.240us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 326.56 K/sec RecvrSide: - FirstBatchArrivalWaitTime: 282.551ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 3s650ms - DataArrivalTimer: 3s650ms SenderSide: - DeserializeRowBatchTime: 8.706us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s440ms, non-child: 1s440ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 77.10 MB (80845381) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.14 MB (79835237) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.14 MB (79835237) - CachedFileHandlesHitCount: 182 (182) - CachedFileHandlesMissCount: 2 (2) - CollectionItemsRead: 0 (0) - DecompressionTime: 962.667ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.48 MB (10986141) - PerReadThreadRawHdfsThroughput: 401.43 MB/sec - RemoteScanRanges: 7 (7) - RowBatchQueueGetWaitTime: 585.883ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 7.04M (7039726) - RowsReturned: 7.03M (7027859) - RowsReturnedRate: 9.18 M/sec - ScanRangesComplete: 1.88K (1875) - ScannerThreadsInvoluntaryContextSwitches: 436 (436) - ScannerThreadsTotalWallClockTime: 1m53s - MaterializeTupleTime(*): 35s112ms - ScannerThreadsSysTime: 375.618ms - ScannerThreadsUserTime: 1s661ms - ScannerThreadsVoluntaryContextSwitches: 10.83K (10827) - TotalRawHdfsReadTime(*): 199.983ms - TotalReadThroughput: 683.95 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 499.20K (499199) - Rows rejected: 11.87K (11866) - Rows total: 7.04M (7039726) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 426.12K (426122) - Rows rejected: 0 (0) - Rows total: 7.03M (7027859) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1875) - Files rejected: 1.84K (1844) - Files total: 1.88K (1875) - RowGroups processed: 6.86K (6860) - RowGroups rejected: 0 (0) - RowGroups total: 6.86K (6860) - Rows processed: 504.80K (504804) - Rows rejected: 0 (0) - Rows total: 7.03M (7027859) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Fragment F02: Instance b04615c310d227c4:3270037300000061 (host=vc1515.foo.com:22000):(Total: 3m7s, non-child: 2m53s, % non-child: 92.59%) Hdfs split stats (:<# splits>/): 1:218/4.76 GB 2:248/5.04 GB 5:237/5.40 GB -1:38/757.06 MB 0:199/4.34 GB 3:249/5.02 GB 4:227/4.72 GB 6:238/4.99 GB 7:225/4.55 GB Filter 0 arrival: 5s969ms Filter 18 arrival: 6s432ms Filter 8 arrival: 1m2s MemoryUsage(4s000ms): 7.71 MB, 13.19 MB, 43.17 MB, 27.06 MB, 49.30 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.23 MB, 45.56 MB, 20.17 MB, 24.81 MB, 35.95 MB, 30.31 MB, 32.08 MB, 37.65 MB, 36.40 MB, 29.07 MB, 31.83 MB, 37.69 MB, 26.29 MB, 33.36 MB, 42.83 MB, 24.51 MB, 42.40 MB, 44.24 MB, 24.73 MB, 39.52 MB, 24.95 MB, 35.97 MB, 33.12 MB, 37.88 MB, 23.95 MB, 37.07 MB, 29.92 MB, 35.22 MB, 27.47 MB, 33.95 MB, 20.25 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 58.16 MB (60985423) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 972.28 MB (1019506758) - RowsProduced: 6.92M (6919096) - TotalNetworkReceiveTime: 4s897ms - TotalNetworkSendTime: 52s574ms - TotalStorageWaitTime: 111.977ms - TotalThreadsInvoluntaryContextSwitches: 1.90K (1895) - TotalThreadsTotalWallClockTime: 5m59s - TotalThreadsSysTime: 1s243ms - TotalThreadsUserTime: 8s156ms - TotalThreadsVoluntaryContextSwitches: 35.36K (35364) Fragment Instance Lifecycle Timings: - ExecTime: 3m - ExecTreeExecTime: 1s685ms - OpenTime: 5s920ms - ExecTreeOpenTime: 5s302ms - PrepareTime: 874.972ms - ExecTreePrepareTime: 33.904ms KrpcDataStreamSender (dst_id=19):(Total: 5s765ms, non-child: 5s765ms, % non-child: 100.00%) - BytesSent: 197.45 MB (207036404) - OverallThroughput: 34.25 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.92M (6919096) - RpcRetry: 0 (0) - SerializeBatchTime: 5s420ms - UncompressedRowBatchSize: 409.11 MB (428983952) CodeGen:(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) - CodegenTime: 3.451ms - CompileTime: 218.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 377.969ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 463.144ms HASH_JOIN_NODE (id=8):(Total: 7s032ms, non-child: 537.061ms, % non-child: 7.64%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 43.198ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.92M (6919096) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 447.142ms - RowsReturned: 6.92M (6919096) - RowsReturnedRate: 983.84 K/sec Buffer pool: - AllocTime: 17.642ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 42.740ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 189.736us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s897ms, non-child: 12.876us, % non-child: 0.00%) - ConvertRowBatchTime: 2.382us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 6.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s897ms - DataArrivalTimer: 4s897ms SenderSide: - DeserializeRowBatchTime: 8.319us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s597ms, non-child: 1s597ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:218/4.76 GB 2:248/5.04 GB 5:237/5.40 GB -1:38/757.06 MB 0:199/4.34 GB 3:249/5.02 GB 4:227/4.72 GB 6:238/4.99 GB 7:225/4.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1849 BytesRead(4s000ms): 0, 1.53 MB, 6.48 MB, 8.31 MB, 11.01 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.39 MB, 12.66 MB, 17.01 MB, 21.23 MB, 22.30 MB, 27.19 MB, 28.99 MB, 31.00 MB, 33.50 MB, 37.33 MB, 39.66 MB, 41.75 MB, 42.75 MB, 44.29 MB, 47.41 MB, 48.50 MB, 48.85 MB, 52.28 MB, 55.05 MB, 55.60 MB, 57.60 MB, 60.70 MB, 62.18 MB, 65.58 MB, 69.26 MB, 71.04 MB, 72.71 MB, 75.44 MB - FooterProcessingTime: (Avg: 1.074ms ; Min: 182.295us ; Max: 5.249ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 75.44 MB (79106897) - BytesReadDataNodeCache: 0 - BytesReadLocal: 75.44 MB (79106897) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 75.44 MB (79106897) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s877ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.87 MB (13491466) - PerReadThreadRawHdfsThroughput: 451.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 377.357ms - RowBatchQueuePutWaitTime: 1m21s - RowsRead: 6.93M (6931005) - RowsReturned: 6.92M (6919096) - RowsReturnedRate: 4.33 M/sec - ScanRangesComplete: 1.88K (1879) - ScannerThreadsInvoluntaryContextSwitches: 172 (172) - ScannerThreadsTotalWallClockTime: 2m53s - MaterializeTupleTime(*): 1m21s - ScannerThreadsSysTime: 420.936ms - ScannerThreadsUserTime: 1s827ms - ScannerThreadsVoluntaryContextSwitches: 15.12K (15117) - TotalRawHdfsReadTime(*): 167.163ms - TotalReadThroughput: 429.18 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.43K (503429) - Rows rejected: 11.91K (11909) - Rows total: 6.93M (6931005) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 411.65K (411648) - Rows rejected: 0 (0) - Rows total: 6.92M (6919096) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1879) - Files rejected: 1.85K (1849) - Files total: 1.88K (1879) - RowGroups processed: 6.75K (6752) - RowGroups rejected: 0 (0) - RowGroups total: 6.75K (6752) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 6.92M (6919096) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:3270037300000069 (host=vc1542.foo.com:22000):(Total: 3m1s, non-child: 2m47s, % non-child: 92.06%) Hdfs split stats (:<# splits>/): 2:205/4.22 GB -1:34/723.41 MB 0:224/4.67 GB 6:228/5.16 GB 4:265/5.39 GB 3:236/5.06 GB 7:237/4.71 GB 5:197/4.20 GB 1:262/5.41 GB Filter 18 arrival: 5s177ms Filter 0 arrival: 7s003ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 2.12 MB, 15.56 MB, 38.70 MB, 28.53 MB, 22.48 MB, 46.89 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.19 MB, 46.64 MB, 24.48 MB, 35.26 MB, 28.37 MB, 37.99 MB, 36.98 MB, 29.30 MB, 35.88 MB, 26.45 MB, 32.69 MB, 30.50 MB, 33.61 MB, 28.99 MB, 38.97 MB, 29.35 MB, 37.48 MB, 25.62 MB, 41.76 MB, 27.65 MB, 36.71 MB, 25.59 MB, 36.75 MB, 35.55 MB, 31.02 MB, 39.87 MB, 24.72 MB, 32.47 MB, 40.71 MB, 28.98 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.81 MB (58523497) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 776.16 MB (813861473) - RowsProduced: 7.13M (7129087) - TotalNetworkReceiveTime: 7.119us - TotalNetworkSendTime: 47s958ms - TotalStorageWaitTime: 218.941ms - TotalThreadsInvoluntaryContextSwitches: 1.99K (1988) - TotalThreadsTotalWallClockTime: 5m45s - TotalThreadsSysTime: 1s276ms - TotalThreadsUserTime: 8s542ms - TotalThreadsVoluntaryContextSwitches: 34.89K (34890) Fragment Instance Lifecycle Timings: - ExecTime: 2m56s - ExecTreeExecTime: 2s042ms - OpenTime: 1s385ms - ExecTreeOpenTime: 399.794ms - PrepareTime: 4s127ms - ExecTreePrepareTime: 207.251ms KrpcDataStreamSender (dst_id=19):(Total: 10s086ms, non-child: 10s086ms, % non-child: 100.00%) - BytesSent: 203.35 MB (213227871) - OverallThroughput: 20.16 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.13M (7129087) - RpcRetry: 0 (0) - SerializeBatchTime: 6s756ms - UncompressedRowBatchSize: 421.53 MB (442003394) CodeGen:(Total: 1s500ms, non-child: 1s500ms, % non-child: 100.00%) - CodegenTime: 2.167ms - CompileTime: 419.894ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 530.404ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 532.744ms HASH_JOIN_NODE (id=8):(Total: 2s832ms, non-child: 619.804ms, % non-child: 21.89%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 64.934ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.13M (7129087) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 510.037ms - RowsReturned: 7.13M (7129087) - RowsReturnedRate: 2.52 M/sec Buffer pool: - AllocTime: 64.157ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 64.330ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 276.929us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 12.058us, non-child: 12.058us, % non-child: 100.00%) - ConvertRowBatchTime: 2.081us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 2.49 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4.504us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 11.250us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s212ms, non-child: 2s212ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:205/4.22 GB -1:34/723.41 MB 0:224/4.67 GB 6:228/5.16 GB 4:265/5.39 GB 3:236/5.06 GB 7:237/4.71 GB 5:197/4.20 GB 1:262/5.41 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.7% 1:0.2967% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1856 BytesRead(4s000ms): 0, 2.44 MB, 5.54 MB, 8.09 MB, 8.09 MB, 11.11 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 12.50 MB, 14.08 MB, 18.63 MB, 19.71 MB, 21.09 MB, 23.22 MB, 25.37 MB, 26.44 MB, 30.07 MB, 34.57 MB, 37.13 MB, 40.35 MB, 43.56 MB, 45.84 MB, 47.75 MB, 49.66 MB, 51.70 MB, 53.63 MB, 56.17 MB, 58.63 MB, 61.14 MB, 65.15 MB, 69.28 MB, 70.30 MB, 72.29 MB, 76.72 MB - FooterProcessingTime: (Avg: 2.201ms ; Min: 371.387us ; Max: 38.742ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 78.09 MB (81885153) - BytesReadDataNodeCache: 0 - BytesReadLocal: 75.87 MB (79560425) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 75.87 MB (79560425) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s006ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10844537) - PerReadThreadRawHdfsThroughput: 368.48 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 340.546ms - RowBatchQueuePutWaitTime: 1m20s - RowsRead: 7.14M (7141630) - RowsReturned: 7.13M (7129087) - RowsReturnedRate: 3.22 M/sec - ScanRangesComplete: 1.89K (1888) - ScannerThreadsInvoluntaryContextSwitches: 205 (205) - ScannerThreadsTotalWallClockTime: 2m47s - MaterializeTupleTime(*): 1m17s - ScannerThreadsSysTime: 432.934ms - ScannerThreadsUserTime: 1s894ms - ScannerThreadsVoluntaryContextSwitches: 14.90K (14903) - TotalRawHdfsReadTime(*): 211.926ms - TotalReadThroughput: 460.90 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 531.71K (531711) - Rows rejected: 12.54K (12543) - Rows total: 7.14M (7141630) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 452.61K (452608) - Rows rejected: 0 (0) - Rows total: 7.13M (7129087) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.89K (1888) - Files rejected: 1.86K (1856) - Files total: 1.89K (1888) - RowGroups processed: 6.96K (6958) - RowGroups rejected: 0 (0) - RowGroups total: 6.96K (6958) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.13M (7129087) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:327003730000006f (host=vc1537.foo.com:22000):(Total: 2m54s, non-child: 2m45s, % non-child: 94.75%) Hdfs split stats (:<# splits>/): -1:20/587.69 MB 0:217/4.86 GB 2:241/4.99 GB 7:216/4.48 GB 1:229/4.74 GB 6:232/4.60 GB 3:221/5.27 GB 5:241/5.27 GB 4:233/4.98 GB Filter 18 arrival: 1s659ms Filter 0 arrival: 7s106ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 21.90 MB, 35.15 MB, 30.94 MB, 44.70 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.96 MB, 42.98 MB, 33.41 MB, 23.66 MB, 38.35 MB, 26.05 MB, 32.19 MB, 32.82 MB, 40.08 MB, 34.12 MB, 29.40 MB, 36.85 MB, 31.97 MB, 36.68 MB, 31.59 MB, 35.73 MB, 33.08 MB, 40.30 MB, 43.03 MB, 27.22 MB, 34.36 MB, 28.33 MB, 36.08 MB, 35.55 MB, 39.38 MB, 35.34 MB, 30.54 MB, 25.85 MB, 15.65 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.05 MB (57722578) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 759.27 MB (796152992) - RowsProduced: 6.26M (6255868) - TotalNetworkReceiveTime: 5.559us - TotalNetworkSendTime: 57s460ms - TotalStorageWaitTime: 122.624ms - TotalThreadsInvoluntaryContextSwitches: 1.80K (1798) - TotalThreadsTotalWallClockTime: 5m35s - TotalThreadsSysTime: 1s167ms - TotalThreadsUserTime: 7s486ms - TotalThreadsVoluntaryContextSwitches: 32.22K (32223) Fragment Instance Lifecycle Timings: - ExecTime: 2m52s - ExecTreeExecTime: 1s703ms - OpenTime: 919.657ms - ExecTreeOpenTime: 298.847ms - PrepareTime: 937.737ms - ExecTreePrepareTime: 130.292ms KrpcDataStreamSender (dst_id=19):(Total: 6s107ms, non-child: 6s107ms, % non-child: 100.00%) - BytesSent: 178.53 MB (187205717) - OverallThroughput: 29.23 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.26M (6255868) - RpcRetry: 0 (0) - SerializeBatchTime: 5s535ms - UncompressedRowBatchSize: 369.90 MB (387863816) CodeGen:(Total: 821.060ms, non-child: 821.060ms, % non-child: 100.00%) - CodegenTime: 2.453ms - CompileTime: 241.966ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 357.116ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 218.329ms HASH_JOIN_NODE (id=8):(Total: 2s243ms, non-child: 562.657ms, % non-child: 25.08%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 102.339ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.26M (6255868) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 409.757ms - RowsReturned: 6.26M (6255868) - RowsReturnedRate: 2.79 M/sec Buffer pool: - AllocTime: 101.565ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 101.725ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 330.903us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 10.099us, non-child: 10.099us, % non-child: 100.00%) - ConvertRowBatchTime: 2.492us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 2.97 M/sec RecvrSide: BytesReceived(500.000ms): 0, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 3.231us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 6.461us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s680ms, non-child: 1s680ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:20/587.69 MB 0:217/4.86 GB 2:241/4.99 GB 7:216/4.48 GB 1:229/4.74 GB 6:232/4.60 GB 3:221/5.27 GB 5:241/5.27 GB 4:233/4.98 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1822 BytesRead(4s000ms): 2.71 MB, 7.43 MB, 9.60 MB, 10.71 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 11.65 MB, 13.07 MB, 14.76 MB, 17.24 MB, 20.68 MB, 23.76 MB, 24.12 MB, 27.10 MB, 30.27 MB, 32.82 MB, 35.41 MB, 38.10 MB, 41.55 MB, 45.93 MB, 49.03 MB, 52.15 MB, 54.82 MB, 54.82 MB, 57.72 MB, 59.87 MB, 60.58 MB, 62.70 MB, 65.34 MB, 68.69 MB, 68.69 MB - FooterProcessingTime: (Avg: 2.028ms ; Min: 85.421us ; Max: 21.305ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 68.69 MB (72027860) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.69 MB (72027860) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.69 MB (72027860) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s165ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10846332) - PerReadThreadRawHdfsThroughput: 404.05 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 106.340ms - RowBatchQueuePutWaitTime: 1m16s - RowsRead: 6.27M (6266072) - RowsReturned: 6.26M (6255868) - RowsReturnedRate: 3.72 M/sec - ScanRangesComplete: 1.85K (1850) - ScannerThreadsInvoluntaryContextSwitches: 212 (212) - ScannerThreadsTotalWallClockTime: 2m41s - MaterializeTupleTime(*): 1m15s - ScannerThreadsSysTime: 394.939ms - ScannerThreadsUserTime: 1s666ms - ScannerThreadsVoluntaryContextSwitches: 13.77K (13769) - TotalRawHdfsReadTime(*): 170.008ms - TotalReadThroughput: 428.90 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 428.00K (427996) - Rows rejected: 10.20K (10204) - Rows total: 6.27M (6266072) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 393.22K (393216) - Rows rejected: 0 (0) - Rows total: 6.26M (6255868) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.85K (1850) - Files rejected: 1.82K (1822) - Files total: 1.85K (1850) - RowGroups processed: 6.11K (6105) - RowGroups rejected: 0 (0) - RowGroups total: 6.11K (6105) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.26M (6255868) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:3270037300000067 (host=vc1509.foo.com:22000):(Total: 2m41s, non-child: 2m27s, % non-child: 91.71%) Hdfs split stats (:<# splits>/): 4:196/3.94 GB 5:223/4.93 GB 6:254/4.83 GB 3:223/4.86 GB 2:251/5.04 GB -1:31/662.50 MB 0:238/5.60 GB 1:236/4.96 GB 7:231/4.73 GB Filter 0 arrival: 5s815ms Filter 18 arrival: 6s729ms Filter 8 arrival: 1m1s MemoryUsage(4s000ms): 2.51 MB, 9.85 MB, 31.96 MB, 32.36 MB, 23.84 MB, 52.38 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.44 MB, 55.52 MB, 40.88 MB, 30.00 MB, 34.22 MB, 32.75 MB, 25.02 MB, 33.90 MB, 36.52 MB, 38.99 MB, 33.11 MB, 26.38 MB, 34.33 MB, 36.42 MB, 35.78 MB, 35.61 MB, 29.50 MB, 27.56 MB, 35.51 MB, 35.90 MB, 34.05 MB, 34.23 MB, 36.92 MB, 22.44 MB, 24.60 MB, 14.70 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58530381) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 745.99 MB (782223629) - RowsProduced: 8.74M (8744432) - TotalNetworkReceiveTime: 5.111us - TotalNetworkSendTime: 51s760ms - TotalStorageWaitTime: 240.321ms - TotalThreadsInvoluntaryContextSwitches: 2.74K (2741) - TotalThreadsTotalWallClockTime: 5m1s - TotalThreadsSysTime: 1s435ms - TotalThreadsUserTime: 9s892ms - TotalThreadsVoluntaryContextSwitches: 35.55K (35552) Fragment Instance Lifecycle Timings: - ExecTime: 2m34s - ExecTreeExecTime: 1s642ms - OpenTime: 1s275ms - ExecTreeOpenTime: 466.104ms - PrepareTime: 5s814ms - ExecTreePrepareTime: 179.064ms KrpcDataStreamSender (dst_id=19):(Total: 9s130ms, non-child: 9s130ms, % non-child: 100.00%) - BytesSent: 249.39 MB (261499282) - OverallThroughput: 27.31 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 8.74M (8744432) - RpcRetry: 0 (0) - SerializeBatchTime: 4s595ms - UncompressedRowBatchSize: 517.04 MB (542154784) CodeGen:(Total: 1s801ms, non-child: 1s801ms, % non-child: 100.00%) - CodegenTime: 2.050ms - CompileTime: 252.404ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 527.092ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 968.891ms HASH_JOIN_NODE (id=8):(Total: 2s440ms, non-child: 715.269ms, % non-child: 29.30%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 105.381ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 8.74M (8744432) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 554.239ms - RowsReturned: 8.74M (8744432) - RowsReturnedRate: 3.58 M/sec Buffer pool: - AllocTime: 104.654ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 104.808ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 249.505us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 10.520us, non-child: 10.520us, % non-child: 100.00%) - ConvertRowBatchTime: 2.448us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 2.85 M/sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 2.959us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 5.995us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s725ms, non-child: 1s725ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:196/3.94 GB 5:223/4.93 GB 6:254/4.83 GB 3:223/4.86 GB 2:251/5.04 GB -1:31/662.50 MB 0:238/5.60 GB 1:236/4.96 GB 7:231/4.73 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 38 out of 38 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:38 PARQUET/Unknown(Skipped):1845 BytesRead(4s000ms): 0, 1.05 MB, 4.67 MB, 6.53 MB, 7.35 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 11.71 MB, 13.85 MB, 18.68 MB, 27.35 MB, 31.59 MB, 35.36 MB, 41.23 MB, 46.87 MB, 48.91 MB, 50.95 MB, 53.72 MB, 56.72 MB, 60.33 MB, 66.06 MB, 68.20 MB, 68.73 MB, 71.80 MB, 77.65 MB, 81.92 MB, 85.94 MB, 91.90 MB, 95.84 MB - FooterProcessingTime: (Avg: 2.615ms ; Min: 406.803us ; Max: 30.458ms ; Number of samples: 38) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 95.84 MB (100497155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.04 MB (97555979) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.04 MB (97555979) - CachedFileHandlesHitCount: 222 (222) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s029ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 38 (38) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10878600) - PerReadThreadRawHdfsThroughput: 387.98 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 330.602ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 8.76M (8759337) - RowsReturned: 8.74M (8744432) - RowsReturnedRate: 5.07 M/sec - ScanRangesComplete: 1.88K (1883) - ScannerThreadsInvoluntaryContextSwitches: 419 (419) - ScannerThreadsTotalWallClockTime: 2m26s - MaterializeTupleTime(*): 1m1s - ScannerThreadsSysTime: 469.928ms - ScannerThreadsUserTime: 2s242ms - ScannerThreadsVoluntaryContextSwitches: 15.50K (15500) - TotalRawHdfsReadTime(*): 247.026ms - TotalReadThroughput: 641.45 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 637.50K (637497) - Rows rejected: 14.90K (14905) - Rows total: 8.76M (8759337) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 558.08K (558080) - Rows rejected: 0 (0) - Rows total: 8.74M (8744432) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1883) - Files rejected: 1.84K (1845) - Files total: 1.88K (1883) - RowGroups processed: 8.53K (8533) - RowGroups rejected: 0 (0) - RowGroups total: 8.53K (8533) - Rows processed: 622.59K (622592) - Rows rejected: 0 (0) - Rows total: 8.74M (8744432) - Splits processed: 38 (38) - Splits rejected: 0 (0) - Splits total: 38 (38) Instance b04615c310d227c4:3270037300000070 (host=vc1536.foo.com:22000):(Total: 2m38s, non-child: 2m25s, % non-child: 91.55%) Hdfs split stats (:<# splits>/): 6:242/4.83 GB 5:230/4.56 GB 7:254/5.31 GB -1:23/457.25 MB 0:234/4.58 GB 3:223/4.91 GB 1:217/4.56 GB 4:222/4.99 GB 2:233/5.37 GB Filter 18 arrival: 6s832ms Filter 0 arrival: 7s130ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 7.83 MB, 9.18 MB, 22.25 MB, 35.91 MB, 35.27 MB, 30.32 MB, 50.77 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.18 MB, 44.93 MB, 33.08 MB, 33.44 MB, 44.75 MB, 29.69 MB, 37.50 MB, 34.96 MB, 39.32 MB, 28.69 MB, 36.84 MB, 25.70 MB, 35.27 MB, 33.11 MB, 42.28 MB, 35.54 MB, 26.58 MB, 44.45 MB, 34.76 MB, 31.31 MB, 43.50 MB, 38.57 MB, 28.36 MB, 20.26 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58528621) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 748.56 MB (784919878) - RowsProduced: 5.86M (5856996) - TotalNetworkReceiveTime: 5s366ms - TotalNetworkSendTime: 56s258ms - TotalStorageWaitTime: 120.496ms - TotalThreadsInvoluntaryContextSwitches: 1.72K (1718) - TotalThreadsTotalWallClockTime: 4m50s - TotalThreadsSysTime: 1s046ms - TotalThreadsUserTime: 6s823ms - TotalThreadsVoluntaryContextSwitches: 28.07K (28074) Fragment Instance Lifecycle Timings: - ExecTime: 2m30s - ExecTreeExecTime: 1s520ms - OpenTime: 7s226ms - ExecTreeOpenTime: 6s638ms - PrepareTime: 746.980ms - ExecTreePrepareTime: 32.277ms KrpcDataStreamSender (dst_id=19):(Total: 4s398ms, non-child: 4s398ms, % non-child: 100.00%) - BytesSent: 167.09 MB (175201408) - OverallThroughput: 37.99 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 5.86M (5856996) - RpcRetry: 0 (0) - SerializeBatchTime: 3s916ms - UncompressedRowBatchSize: 346.31 MB (363133752) CodeGen:(Total: 788.673ms, non-child: 788.673ms, % non-child: 100.00%) - CodegenTime: 2.541ms - CompileTime: 206.477ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 370.400ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 204.098ms HASH_JOIN_NODE (id=8):(Total: 8s206ms, non-child: 565.172ms, % non-child: 6.89%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 150.113ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 5.86M (5856996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 379.485ms - RowsReturned: 5.86M (5856996) - RowsReturnedRate: 713.73 K/sec Buffer pool: - AllocTime: 149.265ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 130.978ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 18.844ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s366ms, non-child: 11.507us, % non-child: 0.00%) - ConvertRowBatchTime: 2.159us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s366ms - DataArrivalTimer: 5s366ms SenderSide: - DeserializeRowBatchTime: 5.350us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 2s274ms, non-child: 2s274ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:242/4.83 GB 5:230/4.56 GB 7:254/5.31 GB -1:23/457.25 MB 0:234/4.58 GB 3:223/4.91 GB 1:217/4.56 GB 4:222/4.99 GB 2:233/5.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 41ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:26 PARQUET/Unknown(Skipped):1852 BytesRead(4s000ms): 0, 556.49 KB, 3.24 MB, 5.05 MB, 7.27 MB, 8.75 MB, 11.63 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 12.47 MB, 14.32 MB, 17.56 MB, 20.53 MB, 22.69 MB, 27.00 MB, 27.00 MB, 28.65 MB, 33.75 MB, 39.39 MB, 40.66 MB, 44.46 MB, 49.63 MB, 53.32 MB, 56.63 MB, 59.65 MB, 62.35 MB, 64.48 MB, 64.48 MB - FooterProcessingTime: (Avg: 1.473ms ; Min: 490.733us ; Max: 7.985ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 64.48 MB (67616986) - BytesReadDataNodeCache: 0 - BytesReadLocal: 64.48 MB (67616986) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 64.48 MB (67616986) - CachedFileHandlesHitCount: 156 (156) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s213ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10845592) - PerReadThreadRawHdfsThroughput: 453.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s225ms - RowBatchQueuePutWaitTime: 1m6s - RowsRead: 5.87M (5867271) - RowsReturned: 5.86M (5856996) - RowsReturnedRate: 2.58 M/sec - ScanRangesComplete: 1.88K (1878) - ScannerThreadsInvoluntaryContextSwitches: 205 (205) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 57s201ms - ScannerThreadsSysTime: 320.951ms - ScannerThreadsUserTime: 1s542ms - ScannerThreadsVoluntaryContextSwitches: 11.82K (11821) - TotalRawHdfsReadTime(*): 142.308ms - TotalReadThroughput: 468.31 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 436.26K (436259) - Rows rejected: 10.28K (10275) - Rows total: 5.87M (5867271) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 357.38K (357376) - Rows rejected: 0 (0) - Rows total: 5.86M (5856996) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1878) - Files rejected: 1.85K (1852) - Files total: 1.88K (1878) - RowGroups processed: 5.71K (5714) - RowGroups rejected: 0 (0) - RowGroups total: 5.71K (5714) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 5.86M (5856996) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance b04615c310d227c4:3270037300000064 (host=vc1525.foo.com:22000):(Total: 2m34s, non-child: 2m21s, % non-child: 91.90%) Hdfs split stats (:<# splits>/): -1:49/892.91 MB 0:218/4.71 GB 5:272/5.62 GB 1:211/4.11 GB 4:228/4.43 GB 3:235/5.00 GB 7:247/5.03 GB 6:240/5.22 GB 2:216/4.59 GB Filter 0 arrival: 6s333ms Filter 18 arrival: 7s026ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 7.95 MB, 11.10 MB, 33.84 MB, 48.63 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 53.03 MB, 52.07 MB, 40.19 MB, 40.40 MB, 31.73 MB, 34.21 MB, 28.70 MB, 36.25 MB, 32.85 MB, 44.65 MB, 28.88 MB, 31.63 MB, 31.56 MB, 37.38 MB, 28.84 MB, 44.58 MB, 32.95 MB, 33.72 MB, 30.27 MB, 32.11 MB, 34.05 MB, 12.23 MB, 10.07 MB, 10.03 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.85 MB (58560265) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 738.35 MB (774214672) - RowsProduced: 8.03M (8034585) - TotalNetworkReceiveTime: 6s107ms - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 175.282ms - TotalThreadsInvoluntaryContextSwitches: 2.71K (2710) - TotalThreadsTotalWallClockTime: 4m46s - TotalThreadsSysTime: 1s340ms - TotalThreadsUserTime: 8s959ms - TotalThreadsVoluntaryContextSwitches: 29.63K (29634) Fragment Instance Lifecycle Timings: - ExecTime: 2m27s - ExecTreeExecTime: 1s504ms - OpenTime: 6s759ms - ExecTreeOpenTime: 6s263ms - PrepareTime: 417.624ms - ExecTreePrepareTime: 20.673ms KrpcDataStreamSender (dst_id=19):(Total: 4s007ms, non-child: 4s007ms, % non-child: 100.00%) - BytesSent: 229.15 MB (240284434) - OverallThroughput: 57.18 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 8.03M (8034585) - RpcRetry: 0 (0) - SerializeBatchTime: 3s874ms - UncompressedRowBatchSize: 475.07 MB (498144270) CodeGen:(Total: 718.862ms, non-child: 718.862ms, % non-child: 100.00%) - CodegenTime: 3.096ms - CompileTime: 126.687ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 340.469ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 245.490ms HASH_JOIN_NODE (id=8):(Total: 7s785ms, non-child: 562.076ms, % non-child: 7.22%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 5.932ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 8.03M (8034585) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 508.206ms - RowsReturned: 8.03M (8034585) - RowsReturnedRate: 1.03 M/sec Buffer pool: - AllocTime: 5.150ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 3.723ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.889ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s107ms, non-child: 15.249us, % non-child: 0.00%) - ConvertRowBatchTime: 2.516us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 364.906ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s107ms - DataArrivalTimer: 6s107ms SenderSide: - DeserializeRowBatchTime: 8.747us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s116ms, non-child: 1s116ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:49/892.91 MB 0:218/4.71 GB 5:272/5.62 GB 1:211/4.11 GB 4:228/4.43 GB 3:235/5.00 GB 7:247/5.03 GB 6:240/5.22 GB 2:216/4.59 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 36 out of 36 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:36 PARQUET/Unknown(Skipped):1880 BytesRead(4s000ms): 0, 762.75 KB, 6.51 MB, 10.61 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.01 MB, 11.28 MB, 15.68 MB, 18.94 MB, 25.29 MB, 30.51 MB, 32.99 MB, 38.04 MB, 43.58 MB, 46.54 MB, 52.67 MB, 58.34 MB, 60.43 MB, 65.59 MB, 70.51 MB, 71.70 MB, 76.13 MB, 79.77 MB, 83.90 MB, 87.60 MB - FooterProcessingTime: (Avg: 2.021ms ; Min: 313.973us ; Max: 17.550ms ; Number of samples: 36) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 87.60 MB (91856098) - BytesReadDataNodeCache: 0 - BytesReadLocal: 86.03 MB (90210833) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 86.03 MB (90210833) - CachedFileHandlesHitCount: 210 (210) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s473ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 36 (36) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10873395) - PerReadThreadRawHdfsThroughput: 395.93 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 157.703ms - RowBatchQueuePutWaitTime: 1m20s - RowsRead: 8.05M (8048981) - RowsReturned: 8.03M (8034585) - RowsReturnedRate: 7.20 M/sec - ScanRangesComplete: 1.92K (1916) - ScannerThreadsInvoluntaryContextSwitches: 564 (564) - ScannerThreadsTotalWallClockTime: 2m11s - MaterializeTupleTime(*): 44s566ms - ScannerThreadsSysTime: 477.927ms - ScannerThreadsUserTime: 1s982ms - ScannerThreadsVoluntaryContextSwitches: 12.54K (12539) - TotalRawHdfsReadTime(*): 221.253ms - TotalReadThroughput: 640.74 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 604.22K (604220) - Rows rejected: 14.40K (14396) - Rows total: 8.05M (8048981) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 538.62K (538624) - Rows rejected: 0 (0) - Rows total: 8.03M (8034585) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.92K (1916) - Files rejected: 1.88K (1880) - Files total: 1.92K (1916) - RowGroups processed: 7.84K (7840) - RowGroups rejected: 0 (0) - RowGroups total: 7.84K (7840) - Rows processed: 589.82K (589824) - Rows rejected: 0 (0) - Rows total: 8.03M (8034585) - Splits processed: 36 (36) - Splits rejected: 0 (0) - Splits total: 36 (36) Instance b04615c310d227c4:327003730000005c (host=vc1516.foo.com:22000):(Total: 2m34s, non-child: 2m20s, % non-child: 91.34%) Hdfs split stats (:<# splits>/): 5:258/5.45 GB 7:227/4.36 GB 2:235/5.14 GB 3:239/4.89 GB 4:227/4.93 GB 6:227/5.12 GB -1:38/770.54 MB 0:238/4.96 GB 1:209/3.95 GB Filter 0 arrival: 6s194ms Filter 18 arrival: 7s008ms Filter 8 arrival: 1m2s MemoryUsage(4s000ms): 7.50 MB, 10.45 MB, 27.59 MB, 37.11 MB, 39.39 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.23 MB, 43.21 MB, 30.11 MB, 34.94 MB, 26.65 MB, 36.69 MB, 32.54 MB, 25.47 MB, 27.94 MB, 32.81 MB, 34.48 MB, 36.87 MB, 31.95 MB, 39.70 MB, 26.98 MB, 32.52 MB, 36.77 MB, 32.42 MB, 38.50 MB, 32.84 MB, 24.12 MB, 23.01 MB, 12.84 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.88 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.42 MB (58108112) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 743.01 MB (779098865) - RowsProduced: 6.95M (6946654) - TotalNetworkReceiveTime: 5s915ms - TotalNetworkSendTime: 57s177ms - TotalStorageWaitTime: 183.103ms - TotalThreadsInvoluntaryContextSwitches: 2.03K (2027) - TotalThreadsTotalWallClockTime: 4m49s - TotalThreadsSysTime: 1s203ms - TotalThreadsUserTime: 7s848ms - TotalThreadsVoluntaryContextSwitches: 29.43K (29427) Fragment Instance Lifecycle Timings: - ExecTime: 2m26s - ExecTreeExecTime: 1s504ms - OpenTime: 6s738ms - ExecTreeOpenTime: 6s187ms - PrepareTime: 534.754ms - ExecTreePrepareTime: 35.815ms KrpcDataStreamSender (dst_id=19):(Total: 4s888ms, non-child: 4s888ms, % non-child: 100.00%) - BytesSent: 198.20 MB (207829632) - OverallThroughput: 40.54 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.95M (6946654) - RpcRetry: 0 (0) - SerializeBatchTime: 4s608ms - UncompressedRowBatchSize: 410.74 MB (430692548) CodeGen:(Total: 719.683ms, non-child: 719.683ms, % non-child: 100.00%) - CodegenTime: 4.458ms - CompileTime: 163.412ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 349.998ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 204.385ms HASH_JOIN_NODE (id=8):(Total: 7s742ms, non-child: 497.000ms, % non-child: 6.42%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 13.072ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.95M (6946654) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 439.322ms - RowsReturned: 6.95M (6946654) - RowsReturnedRate: 897.17 K/sec Buffer pool: - AllocTime: 12.283ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.202ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 5.529ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s915ms, non-child: 12.194us, % non-child: 0.00%) - ConvertRowBatchTime: 2.041us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 152.747ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s915ms - DataArrivalTimer: 5s915ms SenderSide: - DeserializeRowBatchTime: 7.144us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s330ms, non-child: 1s330ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:258/5.45 GB 7:227/4.36 GB 2:235/5.14 GB 3:239/4.89 GB 4:227/4.93 GB 6:227/5.12 GB -1:38/770.54 MB 0:238/4.96 GB 1:209/3.95 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3676% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1868 BytesRead(4s000ms): 0, 750.90 KB, 3.48 MB, 7.04 MB, 9.97 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 12.48 MB, 13.75 MB, 19.05 MB, 21.95 MB, 27.54 MB, 31.87 MB, 36.36 MB, 36.73 MB, 40.67 MB, 44.73 MB, 47.96 MB, 49.74 MB, 52.41 MB, 55.39 MB, 58.24 MB, 62.48 MB, 65.01 MB, 68.73 MB, 73.78 MB - FooterProcessingTime: (Avg: 3.425ms ; Min: 452.573us ; Max: 43.927ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 76.55 MB (80264603) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.55 MB (80264603) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.55 MB (80264603) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s543ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10847812) - PerReadThreadRawHdfsThroughput: 302.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 243.793ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 6.96M (6958630) - RowsReturned: 6.95M (6946654) - RowsReturnedRate: 5.22 M/sec - ScanRangesComplete: 1.90K (1898) - ScannerThreadsInvoluntaryContextSwitches: 256 (256) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 53s747ms - ScannerThreadsSysTime: 398.939ms - ScannerThreadsUserTime: 1s747ms - ScannerThreadsVoluntaryContextSwitches: 12.34K (12340) - TotalRawHdfsReadTime(*): 253.165ms - TotalReadThroughput: 548.13 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.50K (503496) - Rows rejected: 11.98K (11976) - Rows total: 6.96M (6958630) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 417.79K (417792) - Rows rejected: 0 (0) - Rows total: 6.95M (6946654) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.90K (1898) - Files rejected: 1.87K (1868) - Files total: 1.90K (1898) - RowGroups processed: 6.78K (6780) - RowGroups rejected: 0 (0) - RowGroups total: 6.78K (6780) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 6.95M (6946654) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:327003730000005e (host=vc1535.foo.com:22000):(Total: 2m32s, non-child: 2m25s, % non-child: 95.57%) Hdfs split stats (:<# splits>/): 1:228/4.98 GB 5:258/4.87 GB -1:36/715.89 MB 0:224/4.71 GB 2:240/5.17 GB 4:229/4.91 GB 3:248/5.23 GB 6:204/4.37 GB 7:214/4.63 GB Filter 18 arrival: 1s200ms Filter 0 arrival: 7s280ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 21.09 MB, 39.33 MB, 33.34 MB, 42.14 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.41 MB, 55.43 MB, 43.91 MB, 35.31 MB, 38.92 MB, 44.96 MB, 23.79 MB, 33.36 MB, 30.39 MB, 28.86 MB, 35.25 MB, 37.14 MB, 26.55 MB, 34.73 MB, 36.59 MB, 32.95 MB, 29.51 MB, 33.43 MB, 31.39 MB, 32.91 MB, 48.00 MB, 26.71 MB, 23.57 MB, 15.19 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 58.31 MB (61146366) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 777.28 MB (815037365) - RowsProduced: 7.81M (7813296) - TotalNetworkReceiveTime: 29.090ms - TotalNetworkSendTime: 59s146ms - TotalStorageWaitTime: 181.031ms - TotalThreadsInvoluntaryContextSwitches: 2.27K (2273) - TotalThreadsTotalWallClockTime: 4m53s - TotalThreadsSysTime: 1s359ms - TotalThreadsUserTime: 8s759ms - TotalThreadsVoluntaryContextSwitches: 32.31K (32307) Fragment Instance Lifecycle Timings: - ExecTime: 2m31s - ExecTreeExecTime: 1s405ms - OpenTime: 879.222ms - ExecTreeOpenTime: 252.154ms - PrepareTime: 515.875ms - ExecTreePrepareTime: 39.591ms KrpcDataStreamSender (dst_id=19):(Total: 4s256ms, non-child: 4s256ms, % non-child: 100.00%) - BytesSent: 222.79 MB (233607778) - OverallThroughput: 52.34 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.81M (7813296) - RpcRetry: 0 (0) - SerializeBatchTime: 3s965ms - UncompressedRowBatchSize: 461.98 MB (484424352) CodeGen:(Total: 790.140ms, non-child: 790.140ms, % non-child: 100.00%) - CodegenTime: 2.205ms - CompileTime: 179.300ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 424.183ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 181.437ms HASH_JOIN_NODE (id=8):(Total: 1s713ms, non-child: 562.550ms, % non-child: 32.83%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 29.144ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.81M (7813296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 485.286ms - RowsReturned: 7.81M (7813296) - RowsReturnedRate: 4.56 M/sec Buffer pool: - AllocTime: 28.522ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 28.615ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 216.285us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 29.095ms, non-child: 11.445us, % non-child: 0.04%) - ConvertRowBatchTime: 2.210us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 1.03 K/sec RecvrSide: BytesReceived(500.000ms): 0, 0 - FirstBatchArrivalWaitTime: 8.228ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 29.088ms - DataArrivalTimer: 29.084ms SenderSide: - DeserializeRowBatchTime: 9.461us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s121ms, non-child: 1s121ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:228/4.98 GB 5:258/4.87 GB -1:36/715.89 MB 0:224/4.71 GB 2:240/5.17 GB 4:229/4.91 GB 3:248/5.23 GB 6:204/4.37 GB 7:214/4.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 35 out of 35 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:35 PARQUET/Unknown(Skipped):1846 BytesRead(4s000ms): 4.08 MB, 10.48 MB, 12.01 MB, 14.94 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 16.80 MB, 22.26 MB, 30.58 MB, 34.23 MB, 35.61 MB, 38.97 MB, 44.36 MB, 47.58 MB, 48.15 MB, 54.64 MB, 58.78 MB, 61.73 MB, 68.03 MB, 71.69 MB, 74.68 MB, 76.33 MB, 80.50 MB, 83.62 MB, 85.55 MB - FooterProcessingTime: (Avg: 1.787ms ; Min: 357.225us ; Max: 10.559ms ; Number of samples: 35) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 85.83 MB (89997094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 84.29 MB (88381543) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 84.29 MB (88381543) - CachedFileHandlesHitCount: 204 (204) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s796ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 35 (35) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 12.84 MB (13466302) - PerReadThreadRawHdfsThroughput: 411.72 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 165.191ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 7.83M (7825910) - RowsReturned: 7.81M (7813296) - RowsReturnedRate: 6.97 M/sec - ScanRangesComplete: 1.88K (1881) - ScannerThreadsInvoluntaryContextSwitches: 360 (360) - ScannerThreadsTotalWallClockTime: 2m21s - MaterializeTupleTime(*): 1m1s - ScannerThreadsSysTime: 469.928ms - ScannerThreadsUserTime: 1s929ms - ScannerThreadsVoluntaryContextSwitches: 14.32K (14322) - TotalRawHdfsReadTime(*): 208.461ms - TotalReadThroughput: 612.46 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 530.76K (530758) - Rows rejected: 12.61K (12614) - Rows total: 7.83M (7825910) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 478.21K (478208) - Rows rejected: 0 (0) - Rows total: 7.81M (7813296) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1881) - Files rejected: 1.85K (1846) - Files total: 1.88K (1881) - RowGroups processed: 7.63K (7629) - RowGroups rejected: 0 (0) - RowGroups total: 7.63K (7629) - Rows processed: 573.44K (573440) - Rows rejected: 0 (0) - Rows total: 7.81M (7813296) - Splits processed: 35 (35) - Splits rejected: 0 (0) - Splits total: 35 (35) Instance b04615c310d227c4:327003730000004e (host=vc1523.foo.com:22000):(Total: 2m31s, non-child: 2m19s, % non-child: 91.62%) Hdfs split stats (:<# splits>/): 1:237/5.37 GB 3:240/4.72 GB 2:214/4.46 GB 7:220/4.67 GB -1:24/722.01 MB 0:226/4.82 GB 6:228/4.94 GB 4:234/4.76 GB 5:245/5.13 GB Filter 0 arrival: 4s841ms Filter 18 arrival: 5s183ms Filter 8 arrival: 1m1s MemoryUsage(4s000ms): 6.15 MB, 14.10 MB, 36.69 MB, 23.71 MB, 42.78 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 52.52 MB, 50.88 MB, 35.34 MB, 27.45 MB, 34.74 MB, 34.07 MB, 32.07 MB, 26.88 MB, 34.28 MB, 31.12 MB, 36.93 MB, 27.97 MB, 28.85 MB, 47.60 MB, 30.59 MB, 35.89 MB, 34.52 MB, 28.41 MB, 34.82 MB, 34.81 MB, 17.31 MB, 13.11 MB, 10.84 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.33 MB (58014459) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 716.69 MB (751503679) - RowsProduced: 6.46M (6458356) - TotalNetworkReceiveTime: 2s626ms - TotalNetworkSendTime: 57s302ms - TotalStorageWaitTime: 530.945ms - TotalThreadsInvoluntaryContextSwitches: 1.95K (1954) - TotalThreadsTotalWallClockTime: 4m41s - TotalThreadsSysTime: 1s144ms - TotalThreadsUserTime: 7s527ms - TotalThreadsVoluntaryContextSwitches: 28.54K (28537) Fragment Instance Lifecycle Timings: - ExecTime: 2m26s - ExecTreeExecTime: 1s638ms - OpenTime: 3s906ms - ExecTreeOpenTime: 2s998ms - PrepareTime: 1s659ms - ExecTreePrepareTime: 393.615ms KrpcDataStreamSender (dst_id=19):(Total: 5s863ms, non-child: 5s863ms, % non-child: 100.00%) - BytesSent: 184.19 MB (193135039) - OverallThroughput: 31.41 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.46M (6458356) - RpcRetry: 0 (0) - SerializeBatchTime: 5s197ms - UncompressedRowBatchSize: 381.87 MB (400418072) CodeGen:(Total: 1s454ms, non-child: 1s454ms, % non-child: 100.00%) - CodegenTime: 3.693ms - CompileTime: 302.107ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 601.716ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 534.439ms HASH_JOIN_NODE (id=8):(Total: 5s403ms, non-child: 473.408ms, % non-child: 8.76%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 16.238ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.46M (6458356) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 414.886ms - RowsReturned: 6.46M (6458356) - RowsReturnedRate: 1.20 M/sec Buffer pool: - AllocTime: 15.564ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 15.616ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 304.465us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 2s626ms, non-child: 14.515us, % non-child: 0.00%) - ConvertRowBatchTime: 2.365us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 11.00 /sec RecvrSide: BytesReceived(500.000ms): 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 2s626ms - DataArrivalTimer: 2s626ms SenderSide: - DeserializeRowBatchTime: 7.263us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 1 (1) - NumEarlySenders: 1 (1) HDFS_SCAN_NODE (id=0):(Total: 2s304ms, non-child: 2s304ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:237/5.37 GB 3:240/4.72 GB 2:214/4.46 GB 7:220/4.67 GB -1:24/722.01 MB 0:226/4.82 GB 6:228/4.94 GB 4:234/4.76 GB 5:245/5.13 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3717% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1840 BytesRead(4s000ms): 0, 1.70 MB, 6.58 MB, 6.58 MB, 10.14 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 10.90 MB, 12.10 MB, 16.51 MB, 19.64 MB, 24.87 MB, 28.99 MB, 31.59 MB, 34.52 MB, 37.86 MB, 42.10 MB, 45.51 MB, 49.40 MB, 53.18 MB, 53.92 MB, 57.11 MB, 60.44 MB, 62.23 MB, 65.07 MB, 69.73 MB - FooterProcessingTime: (Avg: 10.553ms ; Min: 581.879us ; Max: 253.914ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 70.62 MB (74054281) - BytesReadDataNodeCache: 0 - BytesReadLocal: 70.62 MB (74054281) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 70.62 MB (74054281) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s183ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.33 MB (10829507) - PerReadThreadRawHdfsThroughput: 377.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 607.996ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 6.47M (6469588) - RowsReturned: 6.46M (6458356) - RowsReturnedRate: 2.80 M/sec - ScanRangesComplete: 1.87K (1868) - ScannerThreadsInvoluntaryContextSwitches: 251 (251) - ScannerThreadsTotalWallClockTime: 2m11s - MaterializeTupleTime(*): 50s446ms - ScannerThreadsSysTime: 405.938ms - ScannerThreadsUserTime: 1s632ms - ScannerThreadsVoluntaryContextSwitches: 11.72K (11721) - TotalRawHdfsReadTime(*): 186.884ms - TotalReadThroughput: 518.41 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 469.98K (469984) - Rows rejected: 11.23K (11232) - Rows total: 6.47M (6469588) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 400.38K (400384) - Rows rejected: 0 (0) - Rows total: 6.46M (6458356) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1868) - Files rejected: 1.84K (1840) - Files total: 1.87K (1868) - RowGroups processed: 6.30K (6304) - RowGroups rejected: 0 (0) - RowGroups total: 6.30K (6304) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.46M (6458356) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:327003730000006a (host=vc1539.foo.com:22000):(Total: 2m29s, non-child: 2m16s, % non-child: 91.29%) Hdfs split stats (:<# splits>/): 4:230/4.98 GB -1:24/477.69 MB 0:230/4.64 GB 1:235/4.94 GB 5:237/4.86 GB 3:242/5.66 GB 7:223/4.74 GB 2:229/4.43 GB 6:222/4.84 GB Filter 18 arrival: 5s882ms Filter 0 arrival: 6s360ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 6.64 MB, 17.64 MB, 29.76 MB, 40.77 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.14 MB, 53.17 MB, 41.56 MB, 29.58 MB, 31.62 MB, 36.36 MB, 25.61 MB, 35.19 MB, 32.05 MB, 35.15 MB, 36.94 MB, 30.60 MB, 32.25 MB, 39.38 MB, 31.73 MB, 31.95 MB, 24.82 MB, 32.78 MB, 33.27 MB, 38.38 MB, 25.18 MB, 19.04 MB, 12.03 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.88 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.39 MB (58081876) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 786.79 MB (825004611) - RowsProduced: 7.48M (7482628) - TotalNetworkReceiveTime: 4s239ms - TotalNetworkSendTime: 59s983ms - TotalStorageWaitTime: 526.165ms - TotalThreadsInvoluntaryContextSwitches: 2.42K (2421) - TotalThreadsTotalWallClockTime: 4m39s - TotalThreadsSysTime: 1s236ms - TotalThreadsUserTime: 8s357ms - TotalThreadsVoluntaryContextSwitches: 29.61K (29607) Fragment Instance Lifecycle Timings: - ExecTime: 2m23s - ExecTreeExecTime: 1s366ms - OpenTime: 4s894ms - ExecTreeOpenTime: 4s442ms - PrepareTime: 1s188ms - ExecTreePrepareTime: 255.549ms KrpcDataStreamSender (dst_id=19):(Total: 6s044ms, non-child: 6s044ms, % non-child: 100.00%) - BytesSent: 213.44 MB (223809627) - OverallThroughput: 35.31 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.48M (7482628) - RpcRetry: 0 (0) - SerializeBatchTime: 5s336ms - UncompressedRowBatchSize: 442.43 MB (463922936) CodeGen:(Total: 641.987ms, non-child: 641.987ms, % non-child: 100.00%) - CodegenTime: 1.618ms - CompileTime: 135.284ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 305.210ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 197.768ms HASH_JOIN_NODE (id=8):(Total: 6s296ms, non-child: 514.586ms, % non-child: 8.17%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 1.637ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.48M (7482628) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 466.879ms - RowsReturned: 7.48M (7482628) - RowsReturnedRate: 1.19 M/sec Buffer pool: - AllocTime: 1.035ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.119ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 252.382us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s239ms, non-child: 12.729us, % non-child: 0.00%) - ConvertRowBatchTime: 1.848us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 7.00 /sec RecvrSide: BytesReceived(500.000ms): 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s239ms - DataArrivalTimer: 4s239ms SenderSide: - DeserializeRowBatchTime: 18.645us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s542ms, non-child: 1s542ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:230/4.98 GB -1:24/477.69 MB 0:230/4.64 GB 1:235/4.94 GB 5:237/4.86 GB 3:242/5.66 GB 7:223/4.74 GB 2:229/4.43 GB 6:222/4.84 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.24% 1:0.7634% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:33 PARQUET/Unknown(Skipped):1839 BytesRead(4s000ms): 0, 1.80 MB, 7.61 MB, 10.68 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 10.94 MB, 13.18 MB, 21.98 MB, 28.18 MB, 31.45 MB, 35.97 MB, 42.11 MB, 46.13 MB, 48.97 MB, 51.48 MB, 55.84 MB, 57.47 MB, 61.15 MB, 66.60 MB, 68.07 MB, 72.08 MB, 76.54 MB, 80.60 MB - FooterProcessingTime: (Avg: 11.217ms ; Min: 197.573us ; Max: 164.867ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 81.96 MB (85943507) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.87 MB (80607994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.87 MB (80607994) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 12 (12) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s202ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10838931) - PerReadThreadRawHdfsThroughput: 350.35 MB/sec - RemoteScanRanges: 36 (36) - RowBatchQueueGetWaitTime: 181.026ms - RowBatchQueuePutWaitTime: 1m19s - RowsRead: 7.50M (7495791) - RowsReturned: 7.48M (7482628) - RowsReturnedRate: 4.85 M/sec - ScanRangesComplete: 1.87K (1872) - ScannerThreadsInvoluntaryContextSwitches: 398 (398) - ScannerThreadsTotalWallClockTime: 2m11s - MaterializeTupleTime(*): 46s920ms - ScannerThreadsSysTime: 416.936ms - ScannerThreadsUserTime: 1s874ms - ScannerThreadsVoluntaryContextSwitches: 12.34K (12341) - TotalRawHdfsReadTime(*): 233.943ms - TotalReadThroughput: 612.62 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 550.76K (550763) - Rows rejected: 13.16K (13163) - Rows total: 7.50M (7495791) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 460.80K (460800) - Rows rejected: 0 (0) - Rows total: 7.48M (7482628) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1872) - Files rejected: 1.84K (1839) - Files total: 1.87K (1872) - RowGroups processed: 7.30K (7303) - RowGroups rejected: 0 (0) - RowGroups total: 7.30K (7303) - Rows processed: 540.67K (540672) - Rows rejected: 0 (0) - Rows total: 7.48M (7482628) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance b04615c310d227c4:327003730000005a (host=vc1513.foo.com:22000):(Total: 2m28s, non-child: 2m16s, % non-child: 91.82%) Hdfs split stats (:<# splits>/): 2:239/5.26 GB 1:255/5.49 GB 5:223/4.65 GB 7:209/4.43 GB 6:243/4.84 GB 4:236/4.55 GB 3:205/4.28 GB -1:37/740.57 MB 0:244/5.35 GB Filter 0 arrival: 6s175ms Filter 18 arrival: 6s666ms Filter 8 arrival: 1m2s MemoryUsage(4s000ms): 7.95 MB, 12.64 MB, 37.55 MB, 40.25 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.92 MB, 54.98 MB, 45.57 MB, 37.86 MB, 28.17 MB, 33.85 MB, 33.04 MB, 33.61 MB, 35.91 MB, 30.25 MB, 32.78 MB, 28.14 MB, 37.54 MB, 24.95 MB, 31.48 MB, 36.56 MB, 30.01 MB, 27.85 MB, 37.26 MB, 38.67 MB, 38.04 MB, 24.36 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58527310) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 750.36 MB (786806834) - RowsProduced: 7.52M (7516049) - TotalNetworkReceiveTime: 5s600ms - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 191.412ms - TotalThreadsInvoluntaryContextSwitches: 2.62K (2618) - TotalThreadsTotalWallClockTime: 4m32s - TotalThreadsSysTime: 1s279ms - TotalThreadsUserTime: 8s313ms - TotalThreadsVoluntaryContextSwitches: 29.12K (29117) Fragment Instance Lifecycle Timings: - ExecTime: 2m21s - ExecTreeExecTime: 1s413ms - OpenTime: 6s422ms - ExecTreeOpenTime: 5s835ms - PrepareTime: 408.820ms - ExecTreePrepareTime: 23.101ms KrpcDataStreamSender (dst_id=19):(Total: 4s068ms, non-child: 4s068ms, % non-child: 100.00%) - BytesSent: 214.30 MB (224706221) - OverallThroughput: 52.67 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.52M (7516049) - RpcRetry: 0 (0) - SerializeBatchTime: 3s930ms - UncompressedRowBatchSize: 444.41 MB (465995038) CodeGen:(Total: 792.468ms, non-child: 792.468ms, % non-child: 100.00%) - CodegenTime: 3.550ms - CompileTime: 128.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 372.090ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 285.783ms HASH_JOIN_NODE (id=8):(Total: 7s272ms, non-child: 590.566ms, % non-child: 8.12%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 72.545ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.52M (7516049) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 473.904ms - RowsReturned: 7.52M (7516049) - RowsReturnedRate: 1.03 M/sec Buffer pool: - AllocTime: 71.589ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 68.242ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.968ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s600ms, non-child: 20.921us, % non-child: 0.00%) - ConvertRowBatchTime: 1.750us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 207.398ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s600ms - DataArrivalTimer: 5s600ms SenderSide: - DeserializeRowBatchTime: 6.625us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s081ms, non-child: 1s081ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:239/5.26 GB 1:255/5.49 GB 5:223/4.65 GB 7:209/4.43 GB 6:243/4.84 GB 4:236/4.55 GB 3:205/4.28 GB -1:37/740.57 MB 0:244/5.35 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1859 BytesRead(4s000ms): 0, 1.11 MB, 5.98 MB, 10.60 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 13.20 MB, 15.93 MB, 19.66 MB, 26.25 MB, 31.18 MB, 35.47 MB, 40.70 MB, 47.81 MB, 52.05 MB, 54.75 MB, 60.02 MB, 63.49 MB, 68.25 MB, 72.24 MB, 76.78 MB, 77.86 MB - FooterProcessingTime: (Avg: 1.885ms ; Min: 451.260us ; Max: 14.789ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 82.12 MB (86111835) - BytesReadDataNodeCache: 0 - BytesReadLocal: 78.48 MB (82289554) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78.48 MB (82289554) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s039ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10846526) - PerReadThreadRawHdfsThroughput: 358.25 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 117.238ms - RowBatchQueuePutWaitTime: 1m14s - RowsRead: 7.53M (7528716) - RowsReturned: 7.52M (7516049) - RowsReturnedRate: 6.95 M/sec - ScanRangesComplete: 1.89K (1891) - ScannerThreadsInvoluntaryContextSwitches: 503 (503) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 44s292ms - ScannerThreadsSysTime: 448.931ms - ScannerThreadsUserTime: 1s845ms - ScannerThreadsVoluntaryContextSwitches: 12.48K (12477) - TotalRawHdfsReadTime(*): 229.232ms - TotalReadThroughput: 641.94 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 536.96K (536955) - Rows rejected: 12.67K (12667) - Rows total: 7.53M (7528716) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 432.13K (432128) - Rows rejected: 0 (0) - Rows total: 7.52M (7516049) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.89K (1891) - Files rejected: 1.86K (1859) - Files total: 1.89K (1891) - RowGroups processed: 7.34K (7337) - RowGroups rejected: 0 (0) - RowGroups total: 7.34K (7337) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.52M (7516049) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:3270037300000050 (host=vc1531.foo.com:22000):(Total: 2m24s, non-child: 2m19s, % non-child: 96.05%) Hdfs split stats (:<# splits>/): 5:224/4.66 GB -1:19/369.35 MB 0:245/5.52 GB 4:208/4.25 GB 7:213/4.89 GB 2:237/4.88 GB 1:224/4.92 GB 6:231/4.68 GB 3:243/5.39 GB Filter 18 arrival: 1s288ms Filter 0 arrival: 6s447ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 23.85 MB, 29.96 MB, 29.58 MB, 45.89 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.78 MB, 52.80 MB, 45.40 MB, 31.30 MB, 33.51 MB, 34.66 MB, 32.96 MB, 34.14 MB, 30.65 MB, 36.96 MB, 30.15 MB, 34.35 MB, 32.22 MB, 34.25 MB, 41.19 MB, 32.01 MB, 30.50 MB, 34.29 MB, 31.57 MB, 40.36 MB, 18.95 MB, 10.94 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.63 MB (58330173) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 722.87 MB (757979946) - RowsProduced: 7.69M (7686969) - TotalNetworkReceiveTime: 329.572ms - TotalNetworkSendTime: 59s260ms - TotalStorageWaitTime: 539.294ms - TotalThreadsInvoluntaryContextSwitches: 1.87K (1873) - TotalThreadsTotalWallClockTime: 4m39s - TotalThreadsSysTime: 1s258ms - TotalThreadsUserTime: 8s285ms - TotalThreadsVoluntaryContextSwitches: 31.56K (31563) Fragment Instance Lifecycle Timings: - ExecTime: 2m23s - ExecTreeExecTime: 1s378ms - OpenTime: 852.311ms - ExecTreeOpenTime: 429.856ms - PrepareTime: 521.204ms - ExecTreePrepareTime: 174.400ms KrpcDataStreamSender (dst_id=19):(Total: 2s973ms, non-child: 2s973ms, % non-child: 100.00%) - BytesSent: 219.24 MB (229888752) - OverallThroughput: 73.72 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.69M (7686969) - RpcRetry: 0 (0) - SerializeBatchTime: 2s869ms - UncompressedRowBatchSize: 454.51 MB (476592078) CodeGen:(Total: 612.836ms, non-child: 612.836ms, % non-child: 100.00%) - CodegenTime: 3.035ms - CompileTime: 143.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 273.946ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 183.475ms HASH_JOIN_NODE (id=8):(Total: 2s136ms, non-child: 537.324ms, % non-child: 25.15%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 17.220ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.69M (7686969) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 471.654ms - RowsReturned: 7.69M (7686969) - RowsReturnedRate: 3.60 M/sec Buffer pool: - AllocTime: 16.487ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 14.583ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.374ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 329.577ms, non-child: 13.363us, % non-child: 0.00%) - ConvertRowBatchTime: 2.051us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 91.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B - FirstBatchArrivalWaitTime: 281.485ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 329.568ms - DataArrivalTimer: 329.565ms SenderSide: - DeserializeRowBatchTime: 6.104us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s269ms, non-child: 1s269ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:224/4.66 GB -1:19/369.35 MB 0:245/5.52 GB 4:208/4.25 GB 7:213/4.89 GB 2:237/4.88 GB 1:224/4.92 GB 6:231/4.68 GB 3:243/5.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.63% 1:0.3663% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:33 PARQUET/Unknown(Skipped):1811 BytesRead(4s000ms): 5.12 MB, 14.86 MB, 18.51 MB, 20.03 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 20.77 MB, 23.87 MB, 28.36 MB, 31.25 MB, 34.82 MB, 39.23 MB, 42.12 MB, 47.11 MB, 53.30 MB, 57.39 MB, 60.51 MB, 65.24 MB, 71.12 MB, 74.02 MB, 77.60 MB, 82.12 MB, 83.25 MB, 84.38 MB - FooterProcessingTime: (Avg: 7.067ms ; Min: 289.014us ; Max: 88.630ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 84.38 MB (88474008) - BytesReadDataNodeCache: 0 - BytesReadLocal: 84.38 MB (88474008) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 84.38 MB (88474008) - CachedFileHandlesHitCount: 198 (198) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s196ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10845866) - PerReadThreadRawHdfsThroughput: 499.06 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.031ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 7.70M (7697347) - RowsReturned: 7.69M (7686969) - RowsReturnedRate: 6.06 M/sec - ScanRangesComplete: 1.84K (1844) - ScannerThreadsInvoluntaryContextSwitches: 237 (237) - ScannerThreadsTotalWallClockTime: 2m14s - MaterializeTupleTime(*): 54s125ms - ScannerThreadsSysTime: 430.934ms - ScannerThreadsUserTime: 1s825ms - ScannerThreadsVoluntaryContextSwitches: 13.69K (13689) - TotalRawHdfsReadTime(*): 169.069ms - TotalReadThroughput: 626.09 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 439.43K (439434) - Rows rejected: 10.38K (10378) - Rows total: 7.70M (7697347) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 402.43K (402432) - Rows rejected: 0 (0) - Rows total: 7.69M (7686969) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.84K (1844) - Files rejected: 1.81K (1811) - Files total: 1.84K (1844) - RowGroups processed: 7.51K (7508) - RowGroups rejected: 0 (0) - RowGroups total: 7.51K (7508) - Rows processed: 540.67K (540672) - Rows rejected: 0 (0) - Rows total: 7.69M (7686969) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance b04615c310d227c4:3270037300000057 (host=vc1520.foo.com:22000):(Total: 2m24s, non-child: 2m12s, % non-child: 91.17%) Hdfs split stats (:<# splits>/): 4:211/4.45 GB 2:221/4.56 GB 5:223/5.15 GB 1:233/4.85 GB 7:208/4.10 GB 6:220/4.31 GB -1:28/649.18 MB 0:262/5.54 GB 3:261/5.96 GB Filter 0 arrival: 6s295ms Filter 18 arrival: 7s097ms Filter 8 arrival: 1m2s MemoryUsage(4s000ms): 8.14 MB, 9.42 MB, 35.93 MB, 41.24 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.24 MB, 43.09 MB, 32.53 MB, 38.09 MB, 29.64 MB, 38.91 MB, 31.44 MB, 32.08 MB, 34.50 MB, 43.48 MB, 32.62 MB, 37.45 MB, 31.31 MB, 34.18 MB, 36.37 MB, 30.87 MB, 22.88 MB, 20.16 MB, 17.86 MB, 12.71 MB, 11.91 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.81 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58530419) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 731.31 MB (766833855) - RowsProduced: 7.46M (7462169) - TotalNetworkReceiveTime: 6s339ms - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 120.691ms - TotalThreadsInvoluntaryContextSwitches: 2.45K (2448) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 1s240ms - TotalThreadsUserTime: 8s317ms - TotalThreadsVoluntaryContextSwitches: 27.08K (27084) Fragment Instance Lifecycle Timings: - ExecTime: 2m17s - ExecTreeExecTime: 1s476ms - OpenTime: 7s335ms - ExecTreeOpenTime: 6s818ms - PrepareTime: 239.611ms - ExecTreePrepareTime: 46.052ms KrpcDataStreamSender (dst_id=19):(Total: 3s832ms, non-child: 3s832ms, % non-child: 100.00%) - BytesSent: 212.77 MB (223102032) - OverallThroughput: 55.52 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.46M (7462169) - RpcRetry: 0 (0) - SerializeBatchTime: 3s732ms - UncompressedRowBatchSize: 441.22 MB (462654478) CodeGen:(Total: 596.408ms, non-child: 596.408ms, % non-child: 100.00%) - CodegenTime: 2.990ms - CompileTime: 171.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 336.805ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 81.141ms HASH_JOIN_NODE (id=8):(Total: 8s367ms, non-child: 505.865ms, % non-child: 6.05%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 2.731ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.46M (7462169) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 460.967ms - RowsReturned: 7.46M (7462169) - RowsReturnedRate: 891.84 K/sec Buffer pool: - AllocTime: 1.902ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.640us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.283ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s339ms, non-child: 15.438us, % non-child: 0.00%) - ConvertRowBatchTime: 1.824us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 542.550ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s339ms - DataArrivalTimer: 6s339ms SenderSide: - DeserializeRowBatchTime: 8.666us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s521ms, non-child: 1s521ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:211/4.45 GB 2:221/4.56 GB 5:223/5.15 GB 1:233/4.85 GB 7:208/4.10 GB 6:220/4.31 GB -1:28/649.18 MB 0:262/5.54 GB 3:261/5.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 34 out of 34 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:34 PARQUET/Unknown(Skipped):1833 BytesRead(2s000ms): 0, 0, 0, 1.08 MB, 4.42 MB, 7.02 MB, 8.84 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 10.99 MB, 11.36 MB, 16.14 MB, 19.14 MB, 20.66 MB, 22.62 MB, 27.30 MB, 32.19 MB, 34.39 MB, 37.37 MB, 39.59 MB, 39.59 MB, 43.22 MB, 47.69 MB, 49.71 MB, 54.95 MB, 56.05 MB, 57.15 MB, 57.70 MB, 59.33 MB, 62.20 MB, 66.57 MB, 69.49 MB, 72.62 MB, 73.19 MB, 73.19 MB, 75.32 MB, 75.87 MB, 78.96 MB, 81.14 MB - FooterProcessingTime: (Avg: 1.072ms ; Min: 329.670us ; Max: 5.355ms ; Number of samples: 34) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 81.89 MB (85867824) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.89 MB (85867824) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.89 MB (85867824) - CachedFileHandlesHitCount: 204 (204) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 938.150ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 34 (34) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.36 MB (10867054) - PerReadThreadRawHdfsThroughput: 437.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 436.740ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 7.48M (7475562) - RowsReturned: 7.46M (7462169) - RowsReturnedRate: 4.90 M/sec - ScanRangesComplete: 1.87K (1867) - ScannerThreadsInvoluntaryContextSwitches: 436 (436) - ScannerThreadsTotalWallClockTime: 1m56s - MaterializeTupleTime(*): 39s997ms - ScannerThreadsSysTime: 424.935ms - ScannerThreadsUserTime: 1s808ms - ScannerThreadsVoluntaryContextSwitches: 11.79K (11789) - TotalRawHdfsReadTime(*): 187.107ms - TotalReadThroughput: 676.25 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 570.45K (570449) - Rows rejected: 13.39K (13393) - Rows total: 7.48M (7475562) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 486.40K (486400) - Rows rejected: 0 (0) - Rows total: 7.46M (7462169) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1867) - Files rejected: 1.83K (1833) - Files total: 1.87K (1867) - RowGroups processed: 7.28K (7284) - RowGroups rejected: 0 (0) - RowGroups total: 7.28K (7284) - Rows processed: 557.06K (557056) - Rows rejected: 0 (0) - Rows total: 7.46M (7462169) - Splits processed: 34 (34) - Splits rejected: 0 (0) - Splits total: 34 (34) Instance b04615c310d227c4:3270037300000058 (host=vc1538.foo.com:22000):(Total: 2m19s, non-child: 2m13s, % non-child: 95.40%) Hdfs split stats (:<# splits>/): 4:241/4.96 GB 7:228/5.03 GB 2:200/4.11 GB 1:233/4.75 GB 5:251/5.17 GB -1:33/665.53 MB 0:228/4.80 GB 6:231/4.96 GB 3:232/5.12 GB Filter 18 arrival: 1s368ms Filter 0 arrival: 7s594ms Filter 8 arrival: 1m4s MemoryUsage(4s000ms): 17.60 MB, 33.77 MB, 35.01 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 45.99 MB, 28.78 MB, 34.49 MB, 31.03 MB, 36.67 MB, 30.85 MB, 30.56 MB, 35.02 MB, 31.85 MB, 32.98 MB, 32.30 MB, 34.22 MB, 30.77 MB, 32.30 MB, 39.71 MB, 32.18 MB, 28.04 MB, 22.88 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.07 MB (57742154) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 720.87 MB (755885915) - RowsProduced: 7.05M (7045138) - TotalNetworkReceiveTime: 395.930ms - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 479.681ms - TotalThreadsInvoluntaryContextSwitches: 2.33K (2335) - TotalThreadsTotalWallClockTime: 4m27s - TotalThreadsSysTime: 1s202ms - TotalThreadsUserTime: 8s032ms - TotalThreadsVoluntaryContextSwitches: 28.00K (27996) Fragment Instance Lifecycle Timings: - ExecTime: 2m17s - ExecTreeExecTime: 1s387ms - OpenTime: 1s083ms - ExecTreeOpenTime: 565.933ms - PrepareTime: 450.678ms - ExecTreePrepareTime: 56.579ms KrpcDataStreamSender (dst_id=19):(Total: 3s667ms, non-child: 3s667ms, % non-child: 100.00%) - BytesSent: 200.97 MB (210730495) - OverallThroughput: 54.80 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.05M (7045138) - RpcRetry: 0 (0) - SerializeBatchTime: 3s506ms - UncompressedRowBatchSize: 416.56 MB (436798556) CodeGen:(Total: 698.895ms, non-child: 698.895ms, % non-child: 100.00%) - CodegenTime: 3.030ms - CompileTime: 215.688ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 291.497ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 165.511ms HASH_JOIN_NODE (id=8):(Total: 2s045ms, non-child: 496.228ms, % non-child: 24.26%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 4.613ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.05M (7045138) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 449.404ms - RowsReturned: 7.05M (7045138) - RowsReturnedRate: 3.44 M/sec Buffer pool: - AllocTime: 3.772ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 3.886ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 334.117us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 395.937ms, non-child: 28.362us, % non-child: 0.01%) - ConvertRowBatchTime: 2.162us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 75.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0 - FirstBatchArrivalWaitTime: 375.696ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 395.916ms - DataArrivalTimer: 395.910ms SenderSide: - DeserializeRowBatchTime: 6.630us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s153ms, non-child: 1s153ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:241/4.96 GB 7:228/5.03 GB 2:200/4.11 GB 1:233/4.75 GB 5:251/5.17 GB -1:33/665.53 MB 0:228/4.80 GB 6:231/4.96 GB 3:232/5.12 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.61% 1:0.3891% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:33 PARQUET/Unknown(Skipped):1844 BytesRead(4s000ms): 2.22 MB, 7.82 MB, 13.43 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 16.62 MB, 18.33 MB, 21.90 MB, 25.86 MB, 30.12 MB, 32.92 MB, 37.32 MB, 41.71 MB, 44.52 MB, 49.27 MB, 54.09 MB, 56.46 MB, 61.70 MB, 67.65 MB, 70.93 MB, 75.14 MB - FooterProcessingTime: (Avg: 8.571ms ; Min: 410.199us ; Max: 244.606ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 77.17 MB (80921583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 77.17 MB (80921583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 77.17 MB (80921583) - CachedFileHandlesHitCount: 198 (198) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s472ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.31 MB (10810999) - PerReadThreadRawHdfsThroughput: 431.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 180.544ms - RowBatchQueuePutWaitTime: 1m14s - RowsRead: 7.06M (7057064) - RowsReturned: 7.05M (7045138) - RowsReturnedRate: 6.11 M/sec - ScanRangesComplete: 1.88K (1877) - ScannerThreadsInvoluntaryContextSwitches: 382 (382) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 45s304ms - ScannerThreadsSysTime: 414.936ms - ScannerThreadsUserTime: 1s771ms - ScannerThreadsVoluntaryContextSwitches: 12.05K (12055) - TotalRawHdfsReadTime(*): 178.837ms - TotalReadThroughput: 607.88 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 497.30K (497302) - Rows rejected: 11.93K (11926) - Rows total: 7.06M (7057064) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 438.27K (438272) - Rows rejected: 0 (0) - Rows total: 7.05M (7045138) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1877) - Files rejected: 1.84K (1844) - Files total: 1.88K (1877) - RowGroups processed: 6.88K (6879) - RowGroups rejected: 0 (0) - RowGroups total: 6.88K (6879) - Rows processed: 540.67K (540672) - Rows rejected: 0 (0) - Rows total: 7.05M (7045138) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance b04615c310d227c4:327003730000006b (host=vc1526.foo.com:22000):(Total: 2m19s, non-child: 2m9s, % non-child: 93.15%) Hdfs split stats (:<# splits>/): 2:228/4.86 GB 1:237/4.55 GB 3:195/3.97 GB 6:241/5.01 GB 4:239/5.69 GB -1:33/679.03 MB 0:256/5.65 GB 5:232/4.88 GB 7:221/4.31 GB Filter 18 arrival: 4s527ms Filter 0 arrival: 6s455ms Filter 8 arrival: 1m3s MemoryUsage(4s000ms): 8.14 MB, 27.63 MB, 43.05 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 54.93 MB, 53.73 MB, 40.64 MB, 37.14 MB, 35.14 MB, 36.92 MB, 42.43 MB, 32.73 MB, 35.63 MB, 34.84 MB, 37.25 MB, 31.74 MB, 32.63 MB, 43.62 MB, 32.39 MB, 36.00 MB, 18.43 MB, 16.82 MB, 12.48 MB, 11.28 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.50 MB (58190905) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 717.78 MB (752642172) - RowsProduced: 7.74M (7738433) - TotalNetworkReceiveTime: 3s662ms - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 687.408ms - TotalThreadsInvoluntaryContextSwitches: 2.69K (2687) - TotalThreadsTotalWallClockTime: 4m14s - TotalThreadsSysTime: 1s220ms - TotalThreadsUserTime: 8s509ms - TotalThreadsVoluntaryContextSwitches: 27.38K (27380) Fragment Instance Lifecycle Timings: - ExecTime: 2m14s - ExecTreeExecTime: 1s461ms - OpenTime: 4s592ms - ExecTreeOpenTime: 4s107ms - PrepareTime: 340.445ms - ExecTreePrepareTime: 40.855ms KrpcDataStreamSender (dst_id=19):(Total: 3s247ms, non-child: 3s247ms, % non-child: 100.00%) - BytesSent: 220.72 MB (231445051) - OverallThroughput: 67.96 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.74M (7738433) - RpcRetry: 0 (0) - SerializeBatchTime: 3s130ms - UncompressedRowBatchSize: 457.56 MB (479782846) CodeGen:(Total: 650.649ms, non-child: 650.649ms, % non-child: 100.00%) - CodegenTime: 3.777ms - CompileTime: 116.279ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 351.972ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 179.180ms HASH_JOIN_NODE (id=8):(Total: 5s629ms, non-child: 559.049ms, % non-child: 9.93%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 38.681ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.74M (7738433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 475.410ms - RowsReturned: 7.74M (7738433) - RowsReturnedRate: 1.37 M/sec Buffer pool: - AllocTime: 37.921ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.098ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 295.710us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 3s662ms, non-child: 25.659us, % non-child: 0.00%) - ConvertRowBatchTime: 2.208us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 8.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 483.760ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 3s662ms - DataArrivalTimer: 3s662ms SenderSide: - DeserializeRowBatchTime: 7.103us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s407ms, non-child: 1s407ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:228/4.86 GB 1:237/4.55 GB 3:195/3.97 GB 6:241/5.01 GB 4:239/5.69 GB -1:33/679.03 MB 0:256/5.65 GB 5:232/4.88 GB 7:221/4.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:33 PARQUET/Unknown(Skipped):1849 BytesRead(2s000ms): 0, 0, 1.67 MB, 5.81 MB, 9.09 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 10.91 MB, 11.66 MB, 16.83 MB, 19.81 MB, 22.75 MB, 27.10 MB, 32.64 MB, 35.24 MB, 40.77 MB, 42.74 MB, 46.30 MB, 46.30 MB, 49.17 MB, 53.18 MB, 57.22 MB, 59.76 MB, 60.08 MB, 61.93 MB, 63.78 MB, 66.03 MB, 69.73 MB, 71.95 MB, 74.91 MB, 76.76 MB, 77.48 MB, 79.66 MB, 80.24 MB, 84.10 MB - FooterProcessingTime: (Avg: 14.671ms ; Min: 475.302us ; Max: 240.606ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 84.81 MB (88931714) - BytesReadDataNodeCache: 0 - BytesReadLocal: 84.81 MB (88931714) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 84.81 MB (88931714) - CachedFileHandlesHitCount: 198 (198) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 773.190ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10875814) - PerReadThreadRawHdfsThroughput: 485.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 466.283ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 7.75M (7751134) - RowsReturned: 7.74M (7738433) - RowsReturnedRate: 5.50 M/sec - ScanRangesComplete: 1.88K (1882) - ScannerThreadsInvoluntaryContextSwitches: 587 (587) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 40s344ms - ScannerThreadsSysTime: 409.937ms - ScannerThreadsUserTime: 1s866ms - ScannerThreadsVoluntaryContextSwitches: 11.84K (11837) - TotalRawHdfsReadTime(*): 174.834ms - TotalReadThroughput: 720.72 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 522.65K (522653) - Rows rejected: 12.70K (12701) - Rows total: 7.75M (7751134) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 461.82K (461824) - Rows rejected: 0 (0) - Rows total: 7.74M (7738433) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1882) - Files rejected: 1.85K (1849) - Files total: 1.88K (1882) - RowGroups processed: 7.56K (7558) - RowGroups rejected: 0 (0) - RowGroups total: 7.56K (7558) - Rows processed: 540.67K (540672) - Rows rejected: 0 (0) - Rows total: 7.74M (7738433) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance b04615c310d227c4:3270037300000059 (host=vc1507.foo.com:22000):(Total: 2m18s, non-child: 2m7s, % non-child: 91.77%) Hdfs split stats (:<# splits>/): 2:200/4.16 GB 1:237/4.67 GB -1:39/790.81 MB 0:243/4.75 GB 4:240/5.04 GB 7:238/5.53 GB 3:253/5.17 GB 5:227/4.74 GB 6:221/4.71 GB Filter 0 arrival: 3s753ms Filter 18 arrival: 6s221ms Filter 8 arrival: 1m1s MemoryUsage(4s000ms): 4.59 MB, 14.03 MB, 31.68 MB, 51.21 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.23 MB, 38.63 MB, 39.56 MB, 36.74 MB, 31.53 MB, 36.43 MB, 33.26 MB, 31.24 MB, 31.92 MB, 25.53 MB, 34.59 MB, 34.09 MB, 34.24 MB, 32.72 MB, 36.77 MB, 34.84 MB, 29.09 MB, 17.89 MB, 16.27 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58532762) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 715.12 MB (749861250) - RowsProduced: 6.26M (6256007) - TotalNetworkReceiveTime: 2s244ms - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 640.368ms - TotalThreadsInvoluntaryContextSwitches: 1.98K (1984) - TotalThreadsTotalWallClockTime: 4m10s - TotalThreadsSysTime: 1s075ms - TotalThreadsUserTime: 7s004ms - TotalThreadsVoluntaryContextSwitches: 24.22K (24217) Fragment Instance Lifecycle Timings: - ExecTime: 2m12s - ExecTreeExecTime: 1s459ms - OpenTime: 3s187ms - ExecTreeOpenTime: 2s417ms - PrepareTime: 3s206ms - ExecTreePrepareTime: 91.128ms KrpcDataStreamSender (dst_id=19):(Total: 5s812ms, non-child: 5s812ms, % non-child: 100.00%) - BytesSent: 178.27 MB (186931598) - OverallThroughput: 30.67 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.26M (6256007) - RpcRetry: 0 (0) - SerializeBatchTime: 3s530ms - UncompressedRowBatchSize: 369.90 MB (387872434) CodeGen:(Total: 1s574ms, non-child: 1s574ms, % non-child: 100.00%) - CodegenTime: 2.960ms - CompileTime: 259.900ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 496.574ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 749.310ms HASH_JOIN_NODE (id=8):(Total: 4s042ms, non-child: 433.974ms, % non-child: 10.74%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 665.323us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.26M (6256007) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 395.231ms - RowsReturned: 6.26M (6256007) - RowsReturnedRate: 1.55 M/sec Buffer pool: - AllocTime: 7.992us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 72.403us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 288.667us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 2s244ms, non-child: 12.274us, % non-child: 0.00%) - ConvertRowBatchTime: 2.201us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 13.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 2s244ms - DataArrivalTimer: 2s244ms SenderSide: - DeserializeRowBatchTime: 5.970us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s364ms, non-child: 1s364ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:200/4.16 GB 1:237/4.67 GB -1:39/790.81 MB 0:243/4.75 GB 4:240/5.04 GB 7:238/5.53 GB 3:253/5.17 GB 5:227/4.74 GB 6:221/4.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:99.57% 1:0.431% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:27 PARQUET/Unknown(Skipped):1871 BytesRead(2s000ms): 0, 0, 0, 2.78 MB, 6.61 MB, 8.82 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 14.00 MB, 14.74 MB, 16.99 MB, 19.78 MB, 24.14 MB, 26.84 MB, 30.80 MB, 30.80 MB, 30.80 MB, 34.46 MB, 34.46 MB, 37.73 MB, 40.81 MB, 44.57 MB, 44.57 MB, 45.11 MB, 46.74 MB, 49.64 MB, 50.76 MB, 53.36 MB, 56.12 MB, 57.77 MB, 60.71 MB, 63.49 MB, 67.79 MB, 68.69 MB, 68.69 MB - FooterProcessingTime: (Avg: 15.128ms ; Min: 466.609us ; Max: 334.576ms ; Number of samples: 27) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 68.69 MB (72021996) - BytesReadDataNodeCache: 0 - BytesReadLocal: 68.69 MB (72021996) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 68.69 MB (72021996) - CachedFileHandlesHitCount: 162 (162) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 805.635ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10841323) - PerReadThreadRawHdfsThroughput: 414.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 144.218ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 6.27M (6266725) - RowsReturned: 6.26M (6256007) - RowsReturnedRate: 4.59 M/sec - ScanRangesComplete: 1.90K (1898) - ScannerThreadsInvoluntaryContextSwitches: 330 (330) - ScannerThreadsTotalWallClockTime: 1m55s - MaterializeTupleTime(*): 37s205ms - ScannerThreadsSysTime: 346.947ms - ScannerThreadsUserTime: 1s527ms - ScannerThreadsVoluntaryContextSwitches: 9.93K (9932) - TotalRawHdfsReadTime(*): 165.816ms - TotalReadThroughput: 574.15 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 453.09K (453086) - Rows rejected: 10.72K (10718) - Rows total: 6.27M (6266725) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 366.59K (366592) - Rows rejected: 0 (0) - Rows total: 6.26M (6256007) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.90K (1898) - Files rejected: 1.87K (1871) - Files total: 1.90K (1898) - RowGroups processed: 6.11K (6108) - RowGroups rejected: 0 (0) - RowGroups total: 6.11K (6108) - Rows processed: 442.37K (442368) - Rows rejected: 0 (0) - Rows total: 6.26M (6256007) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Instance b04615c310d227c4:327003730000004f (host=vc1501.foo.com:22000):(Total: 2m18s, non-child: 2m6s, % non-child: 91.23%) Hdfs split stats (:<# splits>/): 5:228/4.76 GB 6:232/5.07 GB 4:236/4.71 GB 7:243/4.95 GB 2:235/4.70 GB 3:219/5.01 GB -1:35/917.31 MB 0:216/4.40 GB 1:233/5.27 GB Filter 0 arrival: 4s113ms Filter 18 arrival: 6s990ms Filter 8 arrival: 1m1s MemoryUsage(4s000ms): 8.14 MB, 10.89 MB, 36.17 MB, 28.62 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.24 MB, 47.25 MB, 26.86 MB, 36.74 MB, 28.00 MB, 32.79 MB, 36.30 MB, 28.88 MB, 34.04 MB, 38.92 MB, 31.18 MB, 32.44 MB, 31.34 MB, 38.28 MB, 31.81 MB, 26.73 MB, 23.45 MB, 14.95 MB, 13.02 MB ThreadUsage(4s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.82 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.14 MB (57821321) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 726.64 MB (761938959) - RowsProduced: 5.80M (5803165) - TotalNetworkReceiveTime: 6s069ms - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 128.139ms - TotalThreadsInvoluntaryContextSwitches: 1.97K (1967) - TotalThreadsTotalWallClockTime: 4m10s - TotalThreadsSysTime: 1s068ms - TotalThreadsUserTime: 6s697ms - TotalThreadsVoluntaryContextSwitches: 23.55K (23545) Fragment Instance Lifecycle Timings: - ExecTime: 2m10s - ExecTreeExecTime: 991.958ms - OpenTime: 7s011ms - ExecTreeOpenTime: 6s400ms - PrepareTime: 302.986ms - ExecTreePrepareTime: 42.202ms KrpcDataStreamSender (dst_id=19):(Total: 3s917ms, non-child: 3s917ms, % non-child: 100.00%) - BytesSent: 165.58 MB (173621802) - OverallThroughput: 42.27 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 5.80M (5803165) - RpcRetry: 0 (0) - SerializeBatchTime: 3s819ms - UncompressedRowBatchSize: 343.13 MB (359796230) CodeGen:(Total: 742.711ms, non-child: 742.711ms, % non-child: 100.00%) - CodegenTime: 2.646ms - CompileTime: 250.451ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 353.975ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 128.448ms HASH_JOIN_NODE (id=8):(Total: 7s460ms, non-child: 408.657ms, % non-child: 5.48%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 7.330ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 5.80M (5803165) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 366.697ms - RowsReturned: 5.80M (5803165) - RowsReturnedRate: 777.82 K/sec Buffer pool: - AllocTime: 6.560ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 6.630ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 250.823us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s069ms, non-child: 17.201us, % non-child: 0.00%) - ConvertRowBatchTime: 2.202us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 289.606ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s069ms - DataArrivalTimer: 6s069ms SenderSide: - DeserializeRowBatchTime: 17.774us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 983.091ms, non-child: 983.091ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:228/4.76 GB 6:232/5.07 GB 4:236/4.71 GB 7:243/4.95 GB 2:235/4.70 GB 3:219/5.01 GB -1:35/917.31 MB 0:216/4.40 GB 1:233/5.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:27 PARQUET/Unknown(Skipped):1850 BytesRead(2s000ms): 0, 0, 0, 1.44 MB, 5.81 MB, 7.20 MB, 7.20 MB, 9.36 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 11.50 MB, 13.71 MB, 14.25 MB, 15.87 MB, 16.95 MB, 20.43 MB, 22.08 MB, 25.44 MB, 26.91 MB, 29.08 MB, 31.24 MB, 32.69 MB, 34.89 MB, 36.75 MB, 40.07 MB, 43.01 MB, 43.76 MB, 43.76 MB, 45.40 MB, 50.34 MB, 50.90 MB, 53.45 MB, 56.86 MB, 59.06 MB, 60.51 MB - FooterProcessingTime: (Avg: 1.697ms ; Min: 440.873us ; Max: 11.212ms ; Number of samples: 27) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 63.46 MB (66539941) - BytesReadDataNodeCache: 0 - BytesReadLocal: 61.33 MB (64304319) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 61.33 MB (64304319) - CachedFileHandlesHitCount: 156 (156) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 996.502ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10837901) - PerReadThreadRawHdfsThroughput: 386.00 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 311.743ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 5.81M (5813901) - RowsReturned: 5.80M (5803165) - RowsReturnedRate: 5.90 M/sec - ScanRangesComplete: 1.88K (1877) - ScannerThreadsInvoluntaryContextSwitches: 340 (340) - ScannerThreadsTotalWallClockTime: 1m52s - MaterializeTupleTime(*): 37s772ms - ScannerThreadsSysTime: 346.947ms - ScannerThreadsUserTime: 1s456ms - ScannerThreadsVoluntaryContextSwitches: 9.72K (9717) - TotalRawHdfsReadTime(*): 164.398ms - TotalReadThroughput: 543.77 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 453.10K (453104) - Rows rejected: 10.74K (10736) - Rows total: 5.81M (5813901) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 363.52K (363520) - Rows rejected: 0 (0) - Rows total: 5.80M (5803165) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1877) - Files rejected: 1.85K (1850) - Files total: 1.88K (1877) - RowGroups processed: 5.66K (5664) - RowGroups rejected: 0 (0) - RowGroups total: 5.66K (5664) - Rows processed: 442.37K (442368) - Rows rejected: 0 (0) - Rows total: 5.80M (5803165) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Instance b04615c310d227c4:327003730000004d (host=vc1541.foo.com:22000):(Total: 2m13s, non-child: 2m6s, % non-child: 94.47%) Hdfs split stats (:<# splits>/): 4:248/5.52 GB 1:226/4.96 GB -1:34/702.44 MB 0:224/4.73 GB 7:227/4.49 GB 5:220/4.73 GB 2:229/5.02 GB 3:237/5.13 GB 6:229/4.26 GB Filter 18 arrival: 1s695ms Filter 0 arrival: 7s487ms Filter 8 arrival: 1m4s MemoryUsage(4s000ms): 14.46 MB, 31.24 MB, 35.25 MB, 43.04 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 55.68 MB, 54.20 MB, 43.44 MB, 35.78 MB, 33.00 MB, 32.33 MB, 32.07 MB, 36.86 MB, 25.64 MB, 40.83 MB, 30.44 MB, 34.90 MB, 22.87 MB, 32.44 MB, 31.50 MB, 26.29 MB, 22.51 MB, 17.61 MB, 13.64 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.79 MB (58495678) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 721.76 MB (756822574) - RowsProduced: 7.40M (7399673) - TotalNetworkReceiveTime: 489.072ms - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 437.006ms - TotalThreadsInvoluntaryContextSwitches: 2.49K (2487) - TotalThreadsTotalWallClockTime: 4m7s - TotalThreadsSysTime: 1s169ms - TotalThreadsUserTime: 7s999ms - TotalThreadsVoluntaryContextSwitches: 25.87K (25873) Fragment Instance Lifecycle Timings: - ExecTime: 2m11s - ExecTreeExecTime: 1s112ms - OpenTime: 1s759ms - ExecTreeOpenTime: 1s237ms - PrepareTime: 445.701ms - ExecTreePrepareTime: 53.151ms KrpcDataStreamSender (dst_id=19):(Total: 4s265ms, non-child: 4s265ms, % non-child: 100.00%) - BytesSent: 210.97 MB (221218044) - OverallThroughput: 49.46 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.40M (7399673) - RpcRetry: 0 (0) - SerializeBatchTime: 4s063ms - UncompressedRowBatchSize: 437.53 MB (458779726) CodeGen:(Total: 695.874ms, non-child: 695.874ms, % non-child: 100.00%) - CodegenTime: 4.857ms - CompileTime: 205.588ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 294.014ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 175.691ms HASH_JOIN_NODE (id=8):(Total: 2s435ms, non-child: 735.656ms, % non-child: 30.20%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 238.419ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.40M (7399673) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 454.479ms - RowsReturned: 7.40M (7399673) - RowsReturnedRate: 3.04 M/sec Buffer pool: - AllocTime: 237.592ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 237.716ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 228.385us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 489.079ms, non-child: 29.497us, % non-child: 0.01%) - ConvertRowBatchTime: 2.787us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 61.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B - FirstBatchArrivalWaitTime: 263.269ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 489.068ms - DataArrivalTimer: 489.051ms SenderSide: - DeserializeRowBatchTime: 6.374us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s210ms, non-child: 1s210ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:248/5.52 GB 1:226/4.96 GB -1:34/702.44 MB 0:224/4.73 GB 7:227/4.49 GB 5:220/4.73 GB 2:229/5.02 GB 3:237/5.13 GB 6:229/4.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.12% 1:0.8772% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1842 BytesRead(2s000ms): 0, 3.54 MB, 6.30 MB, 9.23 MB, 12.45 MB, 12.45 MB, 14.25 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.05 MB, 16.78 MB, 21.07 MB, 25.32 MB, 30.17 MB, 33.99 MB, 36.34 MB, 37.07 MB, 39.98 MB, 45.07 MB, 47.87 MB, 51.78 MB, 53.23 MB, 55.44 MB, 55.44 MB, 57.67 MB, 59.13 MB, 61.99 MB, 66.60 MB, 70.83 MB, 72.19 MB, 72.19 MB, 73.25 MB, 75.94 MB, 78.14 MB, 80.85 MB - FooterProcessingTime: (Avg: 8.656ms ; Min: 436.755us ; Max: 187.072ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 80.85 MB (84774049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.85 MB (84774049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.85 MB (84774049) - CachedFileHandlesHitCount: 192 (192) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 980.827ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10845698) - PerReadThreadRawHdfsThroughput: 454.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 476.917ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 7.41M (7410927) - RowsReturned: 7.40M (7399673) - RowsReturnedRate: 6.11 M/sec - ScanRangesComplete: 1.87K (1874) - ScannerThreadsInvoluntaryContextSwitches: 474 (474) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 38s896ms - ScannerThreadsSysTime: 394.939ms - ScannerThreadsUserTime: 1s736ms - ScannerThreadsVoluntaryContextSwitches: 11.02K (11021) - TotalRawHdfsReadTime(*): 177.954ms - TotalReadThroughput: 713.66 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 470.01K (470006) - Rows rejected: 11.25K (11254) - Rows total: 7.41M (7410927) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 428.03K (428032) - Rows rejected: 0 (0) - Rows total: 7.40M (7399673) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1874) - Files rejected: 1.84K (1842) - Files total: 1.87K (1874) - RowGroups processed: 7.22K (7225) - RowGroups rejected: 0 (0) - RowGroups total: 7.22K (7225) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.40M (7399673) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:327003730000004c (host=vc1519.foo.com:22000):(Total: 2m11s, non-child: 2m5s, % non-child: 95.48%) Hdfs split stats (:<# splits>/): -1:25/828.57 MB 0:246/5.02 GB 5:205/4.40 GB 3:244/5.39 GB 1:224/4.56 GB 6:217/5.30 GB 7:226/4.71 GB 4:237/4.76 GB 2:226/4.80 GB Filter 18 arrival: 1s309ms Filter 0 arrival: 6s236ms Filter 8 arrival: 1m2s MemoryUsage(4s000ms): 22.90 MB, 34.55 MB, 37.19 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.89 MB, 54.81 MB, 44.29 MB, 36.72 MB, 29.68 MB, 32.93 MB, 38.16 MB, 32.53 MB, 25.18 MB, 33.14 MB, 28.67 MB, 27.95 MB, 32.82 MB, 35.76 MB, 40.33 MB, 34.31 MB, 21.04 MB, 12.42 MB ThreadUsage(4s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.84 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58528488) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 699.79 MB (733782863) - RowsProduced: 7.57M (7572901) - TotalNetworkReceiveTime: 587.576ms - TotalNetworkSendTime: 1m12s - TotalStorageWaitTime: 375.480ms - TotalThreadsInvoluntaryContextSwitches: 2.63K (2629) - TotalThreadsTotalWallClockTime: 4m1s - TotalThreadsSysTime: 1s184ms - TotalThreadsUserTime: 8s333ms - TotalThreadsVoluntaryContextSwitches: 25.65K (25652) Fragment Instance Lifecycle Timings: - ExecTime: 2m9s - ExecTreeExecTime: 892.361ms - OpenTime: 1s212ms - ExecTreeOpenTime: 789.453ms - PrepareTime: 278.788ms - ExecTreePrepareTime: 23.816ms KrpcDataStreamSender (dst_id=19):(Total: 3s671ms, non-child: 3s671ms, % non-child: 100.00%) - BytesSent: 216.07 MB (226567804) - OverallThroughput: 58.85 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.57M (7572901) - RpcRetry: 0 (0) - SerializeBatchTime: 3s554ms - UncompressedRowBatchSize: 447.77 MB (469519862) CodeGen:(Total: 551.839ms, non-child: 551.839ms, % non-child: 100.00%) - CodegenTime: 2.365ms - CompileTime: 111.401ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 300.851ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 113.345ms HASH_JOIN_NODE (id=8):(Total: 1s710ms, non-child: 540.412ms, % non-child: 31.60%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 20.192ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.57M (7572901) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 473.973ms - RowsReturned: 7.57M (7572901) - RowsReturnedRate: 4.43 M/sec Buffer pool: - AllocTime: 19.517ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 19.628ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 255.933us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 587.582ms, non-child: 14.363us, % non-child: 0.00%) - ConvertRowBatchTime: 2.332us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 51.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0 - FirstBatchArrivalWaitTime: 538.929ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 587.574ms - DataArrivalTimer: 587.569ms SenderSide: - DeserializeRowBatchTime: 6.411us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 582.164ms, non-child: 582.164ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:25/828.57 MB 0:246/5.02 GB 5:205/4.40 GB 3:244/5.39 GB 1:224/4.56 GB 6:217/5.30 GB 7:226/4.71 GB 4:237/4.76 GB 2:226/4.80 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1818 BytesRead(2s000ms): 931.23 KB, 7.42 MB, 11.75 MB, 13.75 MB, 17.35 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 19.49 MB, 23.23 MB, 23.23 MB, 23.23 MB, 24.56 MB, 29.23 MB, 33.45 MB, 35.46 MB, 36.62 MB, 39.44 MB, 42.99 MB, 47.96 MB, 50.65 MB, 52.29 MB, 53.04 MB, 55.94 MB, 56.69 MB, 59.79 MB, 65.07 MB, 68.06 MB, 72.37 MB, 72.92 MB, 74.41 MB, 77.01 MB, 80.35 MB, 81.83 MB, 83.31 MB - FooterProcessingTime: (Avg: 7.722ms ; Min: 504.443us ; Max: 165.768ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 83.31 MB (87356050) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.11 MB (85046474) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.11 MB (85046474) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 670.038ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.38 MB (10879563) - PerReadThreadRawHdfsThroughput: 406.12 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 125.716ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 7.58M (7584370) - RowsReturned: 7.57M (7572901) - RowsReturnedRate: 13.01 M/sec - ScanRangesComplete: 1.85K (1850) - ScannerThreadsInvoluntaryContextSwitches: 523 (523) - ScannerThreadsTotalWallClockTime: 1m50s - MaterializeTupleTime(*): 34s537ms - ScannerThreadsSysTime: 385.941ms - ScannerThreadsUserTime: 1s804ms - ScannerThreadsVoluntaryContextSwitches: 11.05K (11055) - TotalRawHdfsReadTime(*): 205.134ms - TotalReadThroughput: 745.05 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 473.29K (473293) - Rows rejected: 11.47K (11469) - Rows total: 7.58M (7584370) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 404.48K (404480) - Rows rejected: 0 (0) - Rows total: 7.57M (7572901) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.85K (1850) - Files rejected: 1.82K (1818) - Files total: 1.85K (1850) - RowGroups processed: 7.39K (7394) - RowGroups rejected: 0 (0) - RowGroups total: 7.39K (7394) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.57M (7572901) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:327003730000006c (host=vc1529.foo.com:22000):(Total: 2m8s, non-child: 1m55s, % non-child: 90.29%) Hdfs split stats (:<# splits>/): 1:246/4.92 GB 5:232/4.89 GB 6:216/4.40 GB 7:229/4.73 GB 4:234/5.18 GB 2:245/5.17 GB -1:26/714.14 MB 0:218/4.68 GB 3:229/4.91 GB Filter 0 arrival: 6s393ms Filter 18 arrival: 7s039ms Filter 8 arrival: 1m3s MemoryUsage(2s000ms): 7.83 MB, 8.44 MB, 8.44 MB, 11.35 MB, 16.08 MB, 22.99 MB, 40.72 MB, 26.54 MB, 42.29 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.94 MB, 52.81 MB, 33.43 MB, 34.41 MB, 36.72 MB, 35.67 MB, 41.34 MB, 43.51 MB, 25.60 MB, 30.67 MB, 36.63 MB, 34.28 MB, 36.05 MB, 26.24 MB, 36.66 MB, 28.56 MB, 29.40 MB, 31.97 MB, 37.02 MB, 39.13 MB, 35.80 MB, 22.47 MB, 31.92 MB, 28.15 MB, 28.11 MB, 36.06 MB, 32.57 MB, 28.09 MB, 28.09 MB, 25.98 MB, 22.49 MB, 22.12 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.82 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.83 MB (58537465) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 688.67 MB (722125939) - RowsProduced: 7.10M (7095261) - TotalNetworkReceiveTime: 6s160ms - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 432.717ms - TotalThreadsInvoluntaryContextSwitches: 2.50K (2505) - TotalThreadsTotalWallClockTime: 3m52s - TotalThreadsSysTime: 1s090ms - TotalThreadsUserTime: 7s757ms - TotalThreadsVoluntaryContextSwitches: 24.96K (24958) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 881.994ms - OpenTime: 7s202ms - ExecTreeOpenTime: 6s759ms - PrepareTime: 378.480ms - ExecTreePrepareTime: 42.212ms KrpcDataStreamSender (dst_id=19):(Total: 4s149ms, non-child: 4s149ms, % non-child: 100.00%) - BytesSent: 202.43 MB (212262760) - OverallThroughput: 48.79 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.10M (7095261) - RpcRetry: 0 (0) - SerializeBatchTime: 3s976ms - UncompressedRowBatchSize: 419.53 MB (439906182) CodeGen:(Total: 580.401ms, non-child: 580.401ms, % non-child: 100.00%) - CodegenTime: 2.253ms - CompileTime: 143.595ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 286.657ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 148.157ms HASH_JOIN_NODE (id=8):(Total: 7s706ms, non-child: 529.793ms, % non-child: 6.87%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 57.396ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.10M (7095261) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 431.932ms - RowsReturned: 7.10M (7095261) - RowsReturnedRate: 920.66 K/sec Buffer pool: - AllocTime: 56.582ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 56.737ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 367.446us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s160ms, non-child: 11.314us, % non-child: 0.00%) - ConvertRowBatchTime: 1.538us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 382.305ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s160ms - DataArrivalTimer: 6s160ms SenderSide: - DeserializeRowBatchTime: 5.299us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s016ms, non-child: 1s016ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:246/4.92 GB 5:232/4.89 GB 6:216/4.40 GB 7:229/4.73 GB 4:234/5.18 GB 2:245/5.17 GB -1:26/714.14 MB 0:218/4.68 GB 3:229/4.91 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1845 BytesRead(2s000ms): 0, 0, 0, 1.78 MB, 3.57 MB, 3.57 MB, 5.59 MB, 7.31 MB, 11.04 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 13.24 MB, 14.75 MB, 20.58 MB, 24.69 MB, 28.07 MB, 29.89 MB, 30.63 MB, 34.56 MB, 40.28 MB, 43.93 MB, 46.86 MB, 50.46 MB, 51.17 MB, 53.38 MB, 57.92 MB, 62.44 MB, 65.92 MB, 69.58 MB, 70.68 MB, 70.68 MB, 74.01 MB, 75.84 MB, 76.98 MB - FooterProcessingTime: (Avg: 7.700ms ; Min: 546.958us ; Max: 82.346ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 77.36 MB (81115817) - BytesReadDataNodeCache: 0 - BytesReadLocal: 77.36 MB (81115817) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 77.36 MB (81115817) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1s060ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.38 MB (10879075) - PerReadThreadRawHdfsThroughput: 460.47 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 528.702ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 7.11M (7107073) - RowsReturned: 7.10M (7095261) - RowsReturnedRate: 6.98 M/sec - ScanRangesComplete: 1.88K (1875) - ScannerThreadsInvoluntaryContextSwitches: 522 (522) - ScannerThreadsTotalWallClockTime: 1m45s - MaterializeTupleTime(*): 31s698ms - ScannerThreadsSysTime: 374.943ms - ScannerThreadsUserTime: 1s669ms - ScannerThreadsVoluntaryContextSwitches: 10.45K (10449) - TotalRawHdfsReadTime(*): 167.997ms - TotalReadThroughput: 704.13 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.33K (503332) - Rows rejected: 11.81K (11812) - Rows total: 7.11M (7107073) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 410.62K (410624) - Rows rejected: 0 (0) - Rows total: 7.10M (7095261) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1875) - Files rejected: 1.84K (1845) - Files total: 1.88K (1875) - RowGroups processed: 6.93K (6926) - RowGroups rejected: 0 (0) - RowGroups total: 6.93K (6926) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 7.10M (7095261) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:3270037300000062 (host=vc1517.foo.com:22000):(Total: 2m7s, non-child: 1m43s, % non-child: 81.64%) Hdfs split stats (:<# splits>/): 5:222/4.49 GB 6:254/5.03 GB 4:227/4.83 GB 2:232/4.75 GB 1:239/4.62 GB 3:229/5.21 GB -1:32/711.18 MB 0:236/4.87 GB 7:231/5.08 GB Filter 0 arrival: 5s967ms Filter 18 arrival: 6s803ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 4.80 MB, 8.44 MB, 8.44 MB, 17.16 MB, 32.77 MB, 44.24 MB, 52.61 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.17 MB, 51.68 MB, 46.02 MB, 33.56 MB, 37.96 MB, 33.56 MB, 31.08 MB, 43.15 MB, 53.29 MB, 35.17 MB, 34.79 MB, 32.99 MB, 30.42 MB, 43.78 MB, 32.31 MB, 50.87 MB, 42.57 MB, 16.55 MB, 17.56 MB, 17.87 MB, 27.11 MB, 28.06 MB, 29.15 MB, 36.91 MB, 15.29 MB, 11.65 MB, 11.46 MB, 11.37 MB, 11.00 MB, 10.35 MB, 9.95 MB, 9.20 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.80 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.67 MB (58377186) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 680.43 MB (713482052) - RowsProduced: 6.81M (6809447) - TotalNetworkReceiveTime: 5s363ms - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 11s603ms - TotalThreadsInvoluntaryContextSwitches: 2.22K (2224) - TotalThreadsTotalWallClockTime: 3m48s - TotalThreadsSysTime: 1s020ms - TotalThreadsUserTime: 7s162ms - TotalThreadsVoluntaryContextSwitches: 20.86K (20862) Fragment Instance Lifecycle Timings: - ExecTime: 2m - ExecTreeExecTime: 12s091ms - OpenTime: 5s994ms - ExecTreeOpenTime: 5s453ms - PrepareTime: 891.807ms - ExecTreePrepareTime: 209.443ms KrpcDataStreamSender (dst_id=19):(Total: 4s673ms, non-child: 4s673ms, % non-child: 100.00%) - BytesSent: 194.20 MB (203638617) - OverallThroughput: 41.56 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.81M (6809447) - RpcRetry: 0 (0) - SerializeBatchTime: 4s250ms - UncompressedRowBatchSize: 402.63 MB (422185714) CodeGen:(Total: 757.032ms, non-child: 757.032ms, % non-child: 100.00%) - CodegenTime: 1.630ms - CompileTime: 222.127ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 308.704ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 215.619ms HASH_JOIN_NODE (id=8):(Total: 17s949ms, non-child: 443.466ms, % non-child: 2.47%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 11.488ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.81M (6809447) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 398.025ms - RowsReturned: 6.81M (6809447) - RowsReturnedRate: 379.37 K/sec Buffer pool: - AllocTime: 10.763ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.918ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 213.627us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s363ms, non-child: 13.831us, % non-child: 0.00%) - ConvertRowBatchTime: 2.940us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s363ms - DataArrivalTimer: 5s363ms SenderSide: - DeserializeRowBatchTime: 4.683us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 12s142ms, non-child: 12s142ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:222/4.49 GB 6:254/5.03 GB 4:227/4.83 GB 2:232/4.75 GB 1:239/4.62 GB 3:229/5.21 GB -1:32/711.18 MB 0:236/4.87 GB 7:231/5.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:31 PARQUET/Unknown(Skipped):1871 BytesRead(2s000ms): 0, 0, 0, 1.89 MB, 6.85 MB, 10.29 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 11.82 MB, 12.54 MB, 20.09 MB, 26.37 MB, 33.91 MB, 41.79 MB, 44.99 MB, 44.99 MB, 47.89 MB, 51.55 MB, 55.97 MB, 60.90 MB, 65.46 MB, 68.44 MB, 68.98 MB, 71.55 MB, 72.04 MB, 72.29 MB, 72.95 MB, 73.84 MB, 74.68 MB, 75.15 MB, 75.15 MB - FooterProcessingTime: (Avg: 53.674ms ; Min: 205.014us ; Max: 973.612ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 75.15 MB (78797870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 75.15 MB (78797870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 75.15 MB (78797870) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 461.224ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 7 (7) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10848675) - PerReadThreadRawHdfsThroughput: 497.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11s338ms - RowBatchQueuePutWaitTime: 1m9s - RowsRead: 6.82M (6821880) - RowsReturned: 6.81M (6809447) - RowsReturnedRate: 560.80 K/sec - ScanRangesComplete: 1.90K (1902) - ScannerThreadsInvoluntaryContextSwitches: 527 (527) - ScannerThreadsTotalWallClockTime: 1m42s - MaterializeTupleTime(*): 18s745ms - ScannerThreadsSysTime: 331.949ms - ScannerThreadsUserTime: 1s540ms - ScannerThreadsVoluntaryContextSwitches: 8.84K (8837) - TotalRawHdfsReadTime(*): 151.150ms - TotalReadThroughput: 687.06 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 520.34K (520337) - Rows rejected: 12.43K (12433) - Rows total: 6.82M (6821880) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 418.82K (418816) - Rows rejected: 0 (0) - Rows total: 6.81M (6809447) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.90K (1902) - Files rejected: 1.87K (1871) - Files total: 1.90K (1902) - RowGroups processed: 6.64K (6645) - RowGroups rejected: 0 (0) - RowGroups total: 6.64K (6645) - Rows processed: 507.90K (507904) - Rows rejected: 0 (0) - Rows total: 6.81M (6809447) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance b04615c310d227c4:3270037300000052 (host=vc1527.foo.com:22000):(Total: 2m, non-child: 1m50s, % non-child: 91.66%) Hdfs split stats (:<# splits>/): 5:241/5.56 GB 1:230/4.99 GB -1:25/657.87 MB 0:221/4.59 GB 4:235/4.90 GB 7:234/5.17 GB 2:235/4.69 GB 6:200/4.28 GB 3:228/4.74 GB Filter 18 arrival: 5s207ms Filter 0 arrival: 6s279ms Filter 8 arrival: 1m3s MemoryUsage(2s000ms): 7.46 MB, 8.44 MB, 12.75 MB, 40.49 MB, 29.05 MB, 33.14 MB, 53.11 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.22 MB, 53.29 MB, 30.28 MB, 36.28 MB, 47.64 MB, 39.24 MB, 34.25 MB, 23.90 MB, 33.26 MB, 30.88 MB, 26.14 MB, 35.64 MB, 31.86 MB, 36.77 MB, 27.92 MB, 35.37 MB, 32.66 MB, 35.12 MB, 34.59 MB, 39.72 MB, 26.77 MB, 38.25 MB, 40.91 MB, 27.55 MB, 24.72 MB, 21.83 MB, 21.09 MB, 20.72 MB ThreadUsage(2s000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.77 MB (58482647) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 685.59 MB (718888459) - RowsProduced: 7.06M (7061504) - TotalNetworkReceiveTime: 4s258ms - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 262.344ms - TotalThreadsInvoluntaryContextSwitches: 2.45K (2451) - TotalThreadsTotalWallClockTime: 3m44s - TotalThreadsSysTime: 1s118ms - TotalThreadsUserTime: 7s787ms - TotalThreadsVoluntaryContextSwitches: 24.82K (24822) Fragment Instance Lifecycle Timings: - ExecTime: 1m55s - ExecTreeExecTime: 943.245ms - OpenTime: 4s932ms - ExecTreeOpenTime: 4s418ms - PrepareTime: 433.519ms - ExecTreePrepareTime: 56.047ms KrpcDataStreamSender (dst_id=19):(Total: 3s886ms, non-child: 3s886ms, % non-child: 100.00%) - BytesSent: 201.42 MB (211200644) - OverallThroughput: 51.82 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.06M (7061504) - RpcRetry: 0 (0) - SerializeBatchTime: 3s733ms - UncompressedRowBatchSize: 417.53 MB (437813248) CodeGen:(Total: 710.139ms, non-child: 710.139ms, % non-child: 100.00%) - CodegenTime: 2.597ms - CompileTime: 221.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 278.984ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 205.646ms HASH_JOIN_NODE (id=8):(Total: 5s455ms, non-child: 479.660ms, % non-child: 8.79%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 774.780us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.06M (7061504) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 438.815ms - RowsReturned: 7.06M (7061504) - RowsReturnedRate: 1.29 M/sec Buffer pool: - AllocTime: 7.974us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 71.705us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 254.756us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s258ms, non-child: 13.550us, % non-child: 0.00%) - ConvertRowBatchTime: 2.943us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 7.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 162.588ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s258ms - DataArrivalTimer: 4s258ms SenderSide: - DeserializeRowBatchTime: 9.602us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 716.437ms, non-child: 716.437ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:241/5.56 GB 1:230/4.99 GB -1:25/657.87 MB 0:221/4.59 GB 4:235/4.90 GB 7:234/5.17 GB 2:235/4.69 GB 6:200/4.28 GB 3:228/4.74 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.05% 1:0.9479% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:31 PARQUET/Unknown(Skipped):1818 BytesRead(2s000ms): 0, 0, 1.30 MB, 4.94 MB, 9.28 MB, 9.28 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 11.48 MB, 12.05 MB, 17.42 MB, 19.91 MB, 20.99 MB, 23.92 MB, 26.53 MB, 29.82 MB, 35.27 MB, 40.00 MB, 41.46 MB, 44.08 MB, 47.17 MB, 50.23 MB, 53.83 MB, 57.48 MB, 59.67 MB, 61.88 MB, 66.18 MB, 67.63 MB, 70.76 MB, 74.95 MB, 77.04 MB - FooterProcessingTime: (Avg: 5.572ms ; Min: 352.957us ; Max: 105.459ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 77.04 MB (80782745) - BytesReadDataNodeCache: 0 - BytesReadLocal: 77.04 MB (80782745) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 77.04 MB (80782745) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 623.382ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10846558) - PerReadThreadRawHdfsThroughput: 430.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 107.642ms - RowBatchQueuePutWaitTime: 1m8s - RowsRead: 7.07M (7073655) - RowsReturned: 7.06M (7061504) - RowsReturnedRate: 9.86 M/sec - ScanRangesComplete: 1.85K (1849) - ScannerThreadsInvoluntaryContextSwitches: 509 (509) - ScannerThreadsTotalWallClockTime: 1m44s - MaterializeTupleTime(*): 31s672ms - ScannerThreadsSysTime: 396.939ms - ScannerThreadsUserTime: 1s692ms - ScannerThreadsVoluntaryContextSwitches: 10.85K (10849) - TotalRawHdfsReadTime(*): 179.075ms - TotalReadThroughput: 713.93 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 505.72K (505719) - Rows rejected: 12.15K (12151) - Rows total: 7.07M (7073655) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 447.49K (447488) - Rows rejected: 0 (0) - Rows total: 7.06M (7061504) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.85K (1849) - Files rejected: 1.82K (1818) - Files total: 1.85K (1849) - RowGroups processed: 6.89K (6889) - RowGroups rejected: 0 (0) - RowGroups total: 6.89K (6889) - Rows processed: 507.90K (507904) - Rows rejected: 0 (0) - Rows total: 7.06M (7061504) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance b04615c310d227c4:327003730000005b (host=vc1511.foo.com:22000):(Total: 2m, non-child: 1m49s, % non-child: 91.33%) Hdfs split stats (:<# splits>/): 5:218/4.90 GB 2:214/4.16 GB 1:241/4.96 GB -1:29/581.01 MB 0:254/5.52 GB 4:254/5.74 GB 6:232/4.75 GB 3:231/4.66 GB 7:201/4.31 GB Filter 18 arrival: 6s066ms Filter 0 arrival: 6s280ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 7.46 MB, 8.44 MB, 8.44 MB, 22.74 MB, 31.96 MB, 44.78 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.82 MB, 55.57 MB, 31.07 MB, 33.18 MB, 35.92 MB, 31.54 MB, 30.91 MB, 32.25 MB, 33.36 MB, 34.03 MB, 26.50 MB, 29.09 MB, 35.88 MB, 40.15 MB, 35.87 MB, 26.15 MB, 34.06 MB, 38.72 MB, 19.58 MB, 23.42 MB, 36.18 MB, 29.78 MB, 39.72 MB, 26.40 MB, 29.65 MB, 14.21 MB, 12.95 MB, 9.65 MB, 8.89 MB ThreadUsage(2s000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58529303) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 679.34 MB (712335038) - RowsProduced: 6.34M (6339066) - TotalNetworkReceiveTime: 4s952ms - TotalNetworkSendTime: 1m4s - TotalStorageWaitTime: 197.505ms - TotalThreadsInvoluntaryContextSwitches: 2.07K (2073) - TotalThreadsTotalWallClockTime: 3m44s - TotalThreadsSysTime: 1s030ms - TotalThreadsUserTime: 7s081ms - TotalThreadsVoluntaryContextSwitches: 22.61K (22606) Fragment Instance Lifecycle Timings: - ExecTime: 1m53s - ExecTreeExecTime: 1s259ms - OpenTime: 5s935ms - ExecTreeOpenTime: 5s458ms - PrepareTime: 481.305ms - ExecTreePrepareTime: 42.142ms KrpcDataStreamSender (dst_id=19):(Total: 2s947ms, non-child: 2s947ms, % non-child: 100.00%) - BytesSent: 180.89 MB (189672218) - OverallThroughput: 61.38 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.34M (6339066) - RpcRetry: 0 (0) - SerializeBatchTime: 2s775ms - UncompressedRowBatchSize: 374.82 MB (393022092) CodeGen:(Total: 697.232ms, non-child: 697.232ms, % non-child: 100.00%) - CodegenTime: 3.329ms - CompileTime: 130.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 317.016ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 229.894ms HASH_JOIN_NODE (id=8):(Total: 6s785ms, non-child: 620.996ms, % non-child: 9.15%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 155.374ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.34M (6339066) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 400.749ms - RowsReturned: 6.34M (6339066) - RowsReturnedRate: 934.19 K/sec Buffer pool: - AllocTime: 154.536ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 154.695ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 347.177us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s952ms, non-child: 15.700us, % non-child: 0.00%) - ConvertRowBatchTime: 2.399us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 6.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 350.031ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s952ms - DataArrivalTimer: 4s952ms SenderSide: - DeserializeRowBatchTime: 5.199us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s211ms, non-child: 1s211ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:218/4.90 GB 2:214/4.16 GB 1:241/4.96 GB -1:29/581.01 MB 0:254/5.52 GB 4:254/5.74 GB 6:232/4.75 GB 3:231/4.66 GB 7:201/4.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1846 BytesRead(2s000ms): 0, 0, 0, 3.74 MB, 6.99 MB, 11.29 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 12.20 MB, 13.10 MB, 17.47 MB, 20.26 MB, 21.94 MB, 25.48 MB, 30.50 MB, 31.96 MB, 37.86 MB, 40.06 MB, 40.06 MB, 42.98 MB, 42.98 MB, 47.29 MB, 50.72 MB, 53.07 MB, 56.45 MB, 58.30 MB, 58.30 MB, 60.49 MB, 62.58 MB, 65.37 MB, 67.97 MB - FooterProcessingTime: (Avg: 3.622ms ; Min: 152.732us ; Max: 60.634ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 69.48 MB (72852797) - BytesReadDataNodeCache: 0 - BytesReadLocal: 65.83 MB (69032994) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 65.83 MB (69032994) - CachedFileHandlesHitCount: 162 (162) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 904.828ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10848637) - PerReadThreadRawHdfsThroughput: 358.81 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 343.666ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 6.35M (6350234) - RowsReturned: 6.34M (6339066) - RowsReturnedRate: 5.23 M/sec - ScanRangesComplete: 1.87K (1874) - ScannerThreadsInvoluntaryContextSwitches: 392 (392) - ScannerThreadsTotalWallClockTime: 1m44s - MaterializeTupleTime(*): 28s612ms - ScannerThreadsSysTime: 357.945ms - ScannerThreadsUserTime: 1s509ms - ScannerThreadsVoluntaryContextSwitches: 9.58K (9582) - TotalRawHdfsReadTime(*): 193.636ms - TotalReadThroughput: 638.07 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 469.92K (469920) - Rows rejected: 11.17K (11168) - Rows total: 6.35M (6350234) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 398.34K (398336) - Rows rejected: 0 (0) - Rows total: 6.34M (6339066) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1874) - Files rejected: 1.85K (1846) - Files total: 1.87K (1874) - RowGroups processed: 6.19K (6186) - RowGroups rejected: 0 (0) - RowGroups total: 6.19K (6186) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.34M (6339066) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:327003730000005d (host=vc1540.foo.com:22000):(Total: 1m59s, non-child: 1m54s, % non-child: 95.36%) Hdfs split stats (:<# splits>/): 5:221/5.04 GB 6:236/4.46 GB -1:10/214.44 MB 0:233/4.74 GB 2:225/4.76 GB 1:264/5.66 GB 3:234/4.95 GB 4:215/5.06 GB 7:231/4.66 GB Filter 18 arrival: 1s372ms Filter 0 arrival: 7s600ms Filter 8 arrival: 1m4s MemoryUsage(2s000ms): 12.28 MB, 35.07 MB, 37.24 MB, 36.78 MB, 42.17 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 54.95 MB, 52.61 MB, 29.18 MB, 20.61 MB, 35.95 MB, 29.04 MB, 32.04 MB, 33.21 MB, 32.33 MB, 34.45 MB, 20.73 MB, 28.51 MB, 37.46 MB, 38.33 MB, 33.12 MB, 30.73 MB, 42.47 MB, 32.61 MB, 34.29 MB, 34.18 MB, 30.07 MB, 34.06 MB, 28.78 MB, 21.05 MB, 17.78 MB, 15.78 MB, 14.53 MB, 11.79 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58535490) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 687.82 MB (721232996) - RowsProduced: 6.32M (6315621) - TotalNetworkReceiveTime: 427.234ms - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 199.210ms - TotalThreadsInvoluntaryContextSwitches: 2.18K (2179) - TotalThreadsTotalWallClockTime: 3m42s - TotalThreadsSysTime: 1s028ms - TotalThreadsUserTime: 7s003ms - TotalThreadsVoluntaryContextSwitches: 22.07K (22070) Fragment Instance Lifecycle Timings: - ExecTime: 1m58s - ExecTreeExecTime: 1s133ms - OpenTime: 1s118ms - ExecTreeOpenTime: 540.979ms - PrepareTime: 357.650ms - ExecTreePrepareTime: 70.075ms KrpcDataStreamSender (dst_id=19):(Total: 3s049ms, non-child: 3s049ms, % non-child: 100.00%) - BytesSent: 180.14 MB (188895267) - OverallThroughput: 59.07 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.32M (6315621) - RpcRetry: 0 (0) - SerializeBatchTime: 2s931ms - UncompressedRowBatchSize: 373.43 MB (391568502) CodeGen:(Total: 723.923ms, non-child: 723.923ms, % non-child: 100.00%) - CodegenTime: 2.986ms - CompileTime: 179.456ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 352.221ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 181.326ms HASH_JOIN_NODE (id=8):(Total: 1s799ms, non-child: 437.453ms, % non-child: 24.31%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 10.594ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.32M (6315621) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 391.128ms - RowsReturned: 6.32M (6315621) - RowsReturnedRate: 3.51 M/sec Buffer pool: - AllocTime: 9.816ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.953ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 332.872us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 427.239ms, non-child: 14.189us, % non-child: 0.00%) - ConvertRowBatchTime: 2.078us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 70.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0 - FirstBatchArrivalWaitTime: 406.716ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 427.231ms - DataArrivalTimer: 427.226ms SenderSide: - DeserializeRowBatchTime: 6.926us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 934.596ms, non-child: 934.596ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:221/5.04 GB 6:236/4.46 GB -1:10/214.44 MB 0:233/4.74 GB 2:225/4.76 GB 1:264/5.66 GB 3:234/4.95 GB 4:215/5.06 GB 7:231/4.66 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:99.52% 1:0.4831% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:26 PARQUET/Unknown(Skipped):1843 BytesRead(2s000ms): 905.88 KB, 5.70 MB, 6.42 MB, 10.80 MB, 15.21 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 15.94 MB, 20.23 MB, 24.06 MB, 27.55 MB, 31.64 MB, 36.35 MB, 39.38 MB, 39.38 MB, 40.78 MB, 44.93 MB, 47.30 MB, 50.92 MB, 54.18 MB, 56.71 MB, 58.17 MB, 62.61 MB, 64.80 MB, 68.04 MB - FooterProcessingTime: (Avg: 4.693ms ; Min: 445.716us ; Max: 92.309ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 69.09 MB (72449618) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.09 MB (72449618) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.09 MB (72449618) - CachedFileHandlesHitCount: 156 (156) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 642.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10850842) - PerReadThreadRawHdfsThroughput: 475.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 60.981ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 6.32M (6324563) - RowsReturned: 6.32M (6315621) - RowsReturnedRate: 6.76 M/sec - ScanRangesComplete: 1.87K (1869) - ScannerThreadsInvoluntaryContextSwitches: 496 (496) - ScannerThreadsTotalWallClockTime: 1m42s - MaterializeTupleTime(*): 24s064ms - ScannerThreadsSysTime: 322.950ms - ScannerThreadsUserTime: 1s538ms - ScannerThreadsVoluntaryContextSwitches: 9.32K (9321) - TotalRawHdfsReadTime(*): 145.393ms - TotalReadThroughput: 677.05 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 379.63K (379630) - Rows rejected: 8.94K (8942) - Rows total: 6.32M (6324563) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 339.97K (339968) - Rows rejected: 0 (0) - Rows total: 6.32M (6315621) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1869) - Files rejected: 1.84K (1843) - Files total: 1.87K (1869) - RowGroups processed: 6.17K (6165) - RowGroups rejected: 0 (0) - RowGroups total: 6.17K (6165) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 6.32M (6315621) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance b04615c310d227c4:3270037300000065 (host=vc1524.foo.com:22000):(Total: 1m59s, non-child: 1m52s, % non-child: 94.03%) Hdfs split stats (:<# splits>/): -1:20/401.50 MB 0:220/4.82 GB 5:199/4.38 GB 1:245/5.12 GB 4:225/4.66 GB 3:250/5.32 GB 6:209/4.57 GB 2:262/5.73 GB 7:226/4.54 GB Filter 18 arrival: 2s189ms Filter 0 arrival: 5s810ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 4.15 MB, 30.97 MB, 24.12 MB, 44.47 MB, 26.28 MB, 45.18 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 54.88 MB, 55.00 MB, 50.82 MB, 33.30 MB, 24.82 MB, 33.29 MB, 32.64 MB, 31.71 MB, 38.39 MB, 37.41 MB, 34.57 MB, 32.20 MB, 31.73 MB, 34.82 MB, 27.20 MB, 35.72 MB, 36.11 MB, 25.45 MB, 32.68 MB, 37.50 MB, 21.97 MB, 20.86 MB, 24.52 MB, 35.12 MB, 35.27 MB, 12.47 MB, 11.12 MB, 10.36 MB, 9.51 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.89 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.58 MB (58283339) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 683.65 MB (716862509) - RowsProduced: 6.82M (6817336) - TotalNetworkReceiveTime: 4.676us - TotalNetworkSendTime: 1m2s - TotalStorageWaitTime: 451.839ms - TotalThreadsInvoluntaryContextSwitches: 2.41K (2410) - TotalThreadsTotalWallClockTime: 3m44s - TotalThreadsSysTime: 1s078ms - TotalThreadsUserTime: 7s425ms - TotalThreadsVoluntaryContextSwitches: 23.10K (23100) Fragment Instance Lifecycle Timings: - ExecTime: 1m57s - ExecTreeExecTime: 1s169ms - OpenTime: 745.360ms - ExecTreeOpenTime: 271.105ms - PrepareTime: 1s702ms - ExecTreePrepareTime: 206.878ms KrpcDataStreamSender (dst_id=19):(Total: 4s427ms, non-child: 4s427ms, % non-child: 100.00%) - BytesSent: 194.45 MB (203893390) - OverallThroughput: 43.92 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.82M (6817336) - RpcRetry: 0 (0) - SerializeBatchTime: 3s370ms - UncompressedRowBatchSize: 403.09 MB (422674832) CodeGen:(Total: 882.480ms, non-child: 882.480ms, % non-child: 100.00%) - CodegenTime: 2.517ms - CompileTime: 129.334ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 340.070ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 411.407ms HASH_JOIN_NODE (id=8):(Total: 1s836ms, non-child: 463.863ms, % non-child: 25.26%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 13.761ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.82M (6817336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 413.665ms - RowsReturned: 6.82M (6817336) - RowsReturnedRate: 3.71 M/sec Buffer pool: - AllocTime: 13.138ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.420ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.112ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 7.956us, non-child: 7.956us, % non-child: 100.00%) - ConvertRowBatchTime: 1.885us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 3.77 M/sec RecvrSide: BytesReceived(500.000ms): 0, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 2.454us - DataArrivalTimer: 0.000ns SenderSide: - DeserializeRowBatchTime: 11.767us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s372ms, non-child: 1s372ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:20/401.50 MB 0:220/4.82 GB 5:199/4.38 GB 1:245/5.12 GB 4:225/4.66 GB 3:250/5.32 GB 6:209/4.57 GB 2:262/5.73 GB 7:226/4.54 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 41ms Hdfs Read Thread Concurrency Bucket: 0:99.08% 1:0.9217% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1828 BytesRead(2s000ms): 0, 4.42 MB, 7.99 MB, 10.95 MB, 11.86 MB, 15.34 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 17.52 MB, 18.25 MB, 21.15 MB, 25.54 MB, 29.37 MB, 32.07 MB, 32.99 MB, 36.50 MB, 40.98 MB, 45.69 MB, 49.02 MB, 53.28 MB, 53.99 MB, 57.29 MB, 60.19 MB, 62.60 MB, 65.38 MB, 69.98 MB, 71.65 MB, 71.65 MB, 72.98 MB, 74.58 MB, 74.58 MB - FooterProcessingTime: (Avg: 11.587ms ; Min: 377.059us ; Max: 296.821ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 74.58 MB (78206290) - BytesReadDataNodeCache: 0 - BytesReadLocal: 74.58 MB (78206290) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 74.58 MB (78206290) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 612.502ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10838200) - PerReadThreadRawHdfsThroughput: 170.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 386.540ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 6.83M (6827443) - RowsReturned: 6.82M (6817336) - RowsReturnedRate: 4.97 M/sec - ScanRangesComplete: 1.86K (1856) - ScannerThreadsInvoluntaryContextSwitches: 480 (480) - ScannerThreadsTotalWallClockTime: 1m46s - MaterializeTupleTime(*): 30s072ms - ScannerThreadsSysTime: 346.947ms - ScannerThreadsUserTime: 1s614ms - ScannerThreadsVoluntaryContextSwitches: 9.68K (9675) - TotalRawHdfsReadTime(*): 438.306ms - TotalReadThroughput: 691.16 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 427.90K (427899) - Rows rejected: 10.11K (10107) - Rows total: 6.83M (6827443) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 371.71K (371712) - Rows rejected: 0 (0) - Rows total: 6.82M (6817336) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.86K (1856) - Files rejected: 1.83K (1828) - Files total: 1.86K (1856) - RowGroups processed: 6.66K (6656) - RowGroups rejected: 0 (0) - RowGroups total: 6.66K (6656) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.82M (6817336) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:327003730000005f (host=vc1534.foo.com:22000):(Total: 1m58s, non-child: 1m47s, % non-child: 91.35%) Hdfs split stats (:<# splits>/): -1:22/478.40 MB 0:240/5.11 GB 7:229/4.73 GB 2:240/5.30 GB 1:260/5.53 GB 4:218/4.57 GB 3:203/4.94 GB 6:205/3.94 GB 5:243/4.95 GB Filter 18 arrival: 3s625ms Filter 0 arrival: 4s871ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 2.63 MB, 9.68 MB, 34.95 MB, 30.41 MB, 47.78 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 51.93 MB, 51.31 MB, 42.95 MB, 31.90 MB, 23.25 MB, 37.90 MB, 37.30 MB, 33.50 MB, 32.57 MB, 44.18 MB, 25.35 MB, 36.92 MB, 34.84 MB, 34.42 MB, 34.23 MB, 34.98 MB, 24.33 MB, 29.96 MB, 34.41 MB, 35.51 MB, 37.24 MB, 37.25 MB, 16.93 MB, 13.99 MB, 13.01 MB, 11.33 MB, 10.70 MB, 9.63 MB, 9.05 MB ThreadUsage(2s000ms): 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.57 MB (58265820) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 681.54 MB (714648275) - RowsProduced: 7.24M (7241547) - TotalNetworkReceiveTime: 937.504ms - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 280.420ms - TotalThreadsInvoluntaryContextSwitches: 2.61K (2612) - TotalThreadsTotalWallClockTime: 3m36s - TotalThreadsSysTime: 1s167ms - TotalThreadsUserTime: 7s969ms - TotalThreadsVoluntaryContextSwitches: 24.08K (24081) Fragment Instance Lifecycle Timings: - ExecTime: 1m54s - ExecTreeExecTime: 1s103ms - OpenTime: 1s969ms - ExecTreeOpenTime: 1s289ms - PrepareTime: 1s951ms - ExecTreePrepareTime: 555.725ms KrpcDataStreamSender (dst_id=19):(Total: 5s756ms, non-child: 5s756ms, % non-child: 100.00%) - BytesSent: 206.57 MB (216602107) - OverallThroughput: 35.89 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.24M (7241547) - RpcRetry: 0 (0) - SerializeBatchTime: 4s676ms - UncompressedRowBatchSize: 428.18 MB (448975914) CodeGen:(Total: 966.285ms, non-child: 966.285ms, % non-child: 100.00%) - CodegenTime: 3.928ms - CompileTime: 220.129ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 410.815ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 331.194ms HASH_JOIN_NODE (id=8):(Total: 3s486ms, non-child: 554.527ms, % non-child: 15.90%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 64.082ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.24M (7241547) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 448.008ms - RowsReturned: 7.24M (7241547) - RowsReturnedRate: 2.08 M/sec Buffer pool: - AllocTime: 63.368ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 55.776ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 8.038ms - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 937.510ms, non-child: 13.283us, % non-child: 0.00%) - ConvertRowBatchTime: 2.827us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 31.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 937.501ms - DataArrivalTimer: 937.497ms SenderSide: - DeserializeRowBatchTime: 17.851us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s994ms, non-child: 1s994ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:22/478.40 MB 0:240/5.11 GB 7:229/4.73 GB 2:240/5.30 GB 1:260/5.53 GB 4:218/4.57 GB 3:203/4.94 GB 6:205/3.94 GB 5:243/4.95 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1828 BytesRead(2s000ms): 0, 943.95 KB, 4.81 MB, 8.63 MB, 11.49 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.04 MB, 12.41 MB, 18.26 MB, 24.35 MB, 29.11 MB, 33.19 MB, 36.07 MB, 36.78 MB, 40.22 MB, 44.54 MB, 48.50 MB, 53.34 MB, 57.56 MB, 60.95 MB, 63.87 MB, 67.55 MB, 71.22 MB, 75.58 MB, 78.51 MB, 79.99 MB - FooterProcessingTime: (Avg: 4.085ms ; Min: 168.667us ; Max: 41.895ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 79.99 MB (83874455) - BytesReadDataNodeCache: 0 - BytesReadLocal: 77.25 MB (81001448) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 77.25 MB (81001448) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 639.999ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10842908) - PerReadThreadRawHdfsThroughput: 322.51 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 243.955ms - RowBatchQueuePutWaitTime: 1m12s - RowsRead: 7.25M (7254175) - RowsReturned: 7.24M (7241547) - RowsReturnedRate: 3.63 M/sec - ScanRangesComplete: 1.86K (1860) - ScannerThreadsInvoluntaryContextSwitches: 629 (629) - ScannerThreadsTotalWallClockTime: 1m40s - MaterializeTupleTime(*): 24s735ms - ScannerThreadsSysTime: 394.939ms - ScannerThreadsUserTime: 1s736ms - ScannerThreadsVoluntaryContextSwitches: 10.32K (10323) - TotalRawHdfsReadTime(*): 248.022ms - TotalReadThroughput: 761.94 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 531.80K (531796) - Rows rejected: 12.63K (12628) - Rows total: 7.25M (7254175) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 454.66K (454656) - Rows rejected: 0 (0) - Rows total: 7.24M (7241547) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.86K (1860) - Files rejected: 1.83K (1828) - Files total: 1.86K (1860) - RowGroups processed: 7.07K (7068) - RowGroups rejected: 0 (0) - RowGroups total: 7.07K (7068) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.24M (7241547) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:327003730000006d (host=vc1510.foo.com:22000):(Total: 1m47s, non-child: 1m38s, % non-child: 91.21%) Hdfs split stats (:<# splits>/): 5:239/4.67 GB 4:221/4.34 GB 3:228/4.69 GB -1:31/711.03 MB 0:250/5.08 GB 7:245/5.67 GB 6:215/4.34 GB 1:242/4.83 GB 2:223/5.24 GB Filter 18 arrival: 6s086ms Filter 0 arrival: 6s356ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 7.47 MB, 8.44 MB, 8.44 MB, 48.81 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 42.80 MB, 40.47 MB, 34.34 MB, 28.72 MB, 42.07 MB, 40.64 MB, 36.60 MB, 36.98 MB, 22.20 MB, 28.02 MB, 34.83 MB, 26.13 MB, 40.92 MB, 32.65 MB, 21.54 MB, 24.82 MB, 32.59 MB, 26.88 MB, 23.45 MB, 20.09 MB, 19.35 MB, 19.35 MB, 12.53 MB ThreadUsage(2s000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.69 MB (58394986) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 649.00 MB (680528981) - RowsProduced: 6.53M (6528620) - TotalNetworkReceiveTime: 5s630ms - TotalNetworkSendTime: 1m15s - TotalStorageWaitTime: 509.015ms - TotalThreadsInvoluntaryContextSwitches: 1.77K (1768) - TotalThreadsTotalWallClockTime: 3m18s - TotalThreadsSysTime: 906.862ms - TotalThreadsUserTime: 6s203ms - TotalThreadsVoluntaryContextSwitches: 17.04K (17036) Fragment Instance Lifecycle Timings: - ExecTime: 1m41s - ExecTreeExecTime: 605.509ms - OpenTime: 6s031ms - ExecTreeOpenTime: 5s721ms - PrepareTime: 135.725ms - ExecTreePrepareTime: 21.567ms KrpcDataStreamSender (dst_id=19):(Total: 2s725ms, non-child: 2s725ms, % non-child: 100.00%) - BytesSent: 186.25 MB (195294490) - OverallThroughput: 68.32 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.53M (6528620) - RpcRetry: 0 (0) - SerializeBatchTime: 2s673ms - UncompressedRowBatchSize: 386.02 MB (404774440) CodeGen:(Total: 361.573ms, non-child: 361.573ms, % non-child: 100.00%) - CodegenTime: 3.167ms - CompileTime: 101.276ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 202.115ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 56.500ms HASH_JOIN_NODE (id=8):(Total: 6s359ms, non-child: 391.885ms, % non-child: 6.16%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 11.714ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.53M (6528620) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 352.231ms - RowsReturned: 6.53M (6528620) - RowsReturnedRate: 1.03 M/sec Buffer pool: - AllocTime: 10.862ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.848ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 532.812us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s630ms, non-child: 15.148us, % non-child: 0.00%) - ConvertRowBatchTime: 2.232us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 941.350ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s630ms - DataArrivalTimer: 5s630ms SenderSide: - DeserializeRowBatchTime: 8.219us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 336.991ms, non-child: 336.991ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:239/4.67 GB 4:221/4.34 GB 3:228/4.69 GB -1:31/711.03 MB 0:250/5.08 GB 7:245/5.67 GB 6:215/4.34 GB 1:242/4.83 GB 2:223/5.24 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 40ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1866 BytesRead(2s000ms): 0, 0, 0, 10.38 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 12.37 MB, 14.20 MB, 20.42 MB, 26.02 MB, 32.79 MB, 34.99 MB, 34.99 MB, 37.93 MB, 44.75 MB, 50.40 MB, 55.91 MB, 61.36 MB, 63.55 MB, 63.55 MB, 65.75 MB, 70.60 MB - FooterProcessingTime: (Avg: 9.601ms ; Min: 515.648us ; Max: 116.921ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 71.55 MB (75030768) - BytesReadDataNodeCache: 0 - BytesReadLocal: 71.55 MB (75030768) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 71.55 MB (75030768) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 275.392ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10838846) - PerReadThreadRawHdfsThroughput: 246.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 28.302ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 6.54M (6539650) - RowsReturned: 6.53M (6528620) - RowsReturnedRate: 19.37 M/sec - ScanRangesComplete: 1.89K (1894) - ScannerThreadsInvoluntaryContextSwitches: 496 (496) - ScannerThreadsTotalWallClockTime: 1m31s - MaterializeTupleTime(*): 11s907ms - ScannerThreadsSysTime: 325.950ms - ScannerThreadsUserTime: 1s415ms - ScannerThreadsVoluntaryContextSwitches: 7.53K (7532) - TotalRawHdfsReadTime(*): 290.678ms - TotalReadThroughput: 759.30 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 463.35K (463348) - Rows rejected: 11.03K (11030) - Rows total: 6.54M (6539650) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 399.36K (399360) - Rows rejected: 0 (0) - Rows total: 6.53M (6528620) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.89K (1894) - Files rejected: 1.87K (1866) - Files total: 1.89K (1894) - RowGroups processed: 6.37K (6369) - RowGroups rejected: 0 (0) - RowGroups total: 6.37K (6369) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.53M (6528620) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:3270037300000068 (host=vc1503.foo.com:22000):(Total: 1m45s, non-child: 1m37s, % non-child: 92.46%) Hdfs split stats (:<# splits>/): 3:231/4.37 GB -1:29/592.79 MB 0:242/5.12 GB 1:232/4.70 GB 7:244/5.20 GB 4:242/5.02 GB 6:218/5.12 GB 5:219/5.04 GB 2:215/4.41 GB Filter 0 arrival: 3s935ms Filter 18 arrival: 5s104ms Filter 8 arrival: 1m1s MemoryUsage(2s000ms): 6.76 MB, 8.44 MB, 15.71 MB, 27.00 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 21.65 MB, 40.82 MB, 43.40 MB, 35.54 MB, 36.83 MB, 24.07 MB, 25.37 MB, 29.27 MB, 46.46 MB, 44.58 MB, 38.96 MB, 42.04 MB, 26.32 MB, 30.79 MB, 28.36 MB, 32.76 MB, 16.90 MB, 10.63 MB, 10.39 MB, 10.18 MB, 9.04 MB, 8.83 MB ThreadUsage(2s000ms): 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.82 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58528462) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 617.81 MB (647823328) - RowsProduced: 7.21M (7213715) - TotalNetworkReceiveTime: 4s449ms - TotalNetworkSendTime: 1m21s - TotalStorageWaitTime: 246.177ms - TotalThreadsInvoluntaryContextSwitches: 1.64K (1644) - TotalThreadsTotalWallClockTime: 3m12s - TotalThreadsSysTime: 926.859ms - TotalThreadsUserTime: 6s500ms - TotalThreadsVoluntaryContextSwitches: 17.28K (17276) Fragment Instance Lifecycle Timings: - ExecTime: 1m40s - ExecTreeExecTime: 560.241ms - OpenTime: 4s895ms - ExecTreeOpenTime: 4s524ms - PrepareTime: 275.385ms - ExecTreePrepareTime: 32.921ms KrpcDataStreamSender (dst_id=19):(Total: 2s369ms, non-child: 2s369ms, % non-child: 100.00%) - BytesSent: 205.83 MB (215826163) - OverallThroughput: 86.86 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.21M (7213715) - RpcRetry: 0 (0) - SerializeBatchTime: 2s243ms - UncompressedRowBatchSize: 426.53 MB (447250330) CodeGen:(Total: 473.070ms, non-child: 473.070ms, % non-child: 100.00%) - CodegenTime: 2.428ms - CompileTime: 116.389ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 250.116ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 99.457ms HASH_JOIN_NODE (id=8):(Total: 5s138ms, non-child: 394.431ms, % non-child: 7.68%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 8.061ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.21M (7213715) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 356.364ms - RowsReturned: 7.21M (7213715) - RowsReturnedRate: 1.40 M/sec Buffer pool: - AllocTime: 7.261ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.374ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 338.885us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s449ms, non-child: 14.215us, % non-child: 0.00%) - ConvertRowBatchTime: 2.148us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 6.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 370.019ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s449ms - DataArrivalTimer: 4s449ms SenderSide: - DeserializeRowBatchTime: 6.404us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 294.591ms, non-child: 294.591ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:231/4.37 GB -1:29/592.79 MB 0:242/5.12 GB 1:232/4.70 GB 7:244/5.20 GB 4:242/5.02 GB 6:218/5.12 GB 5:219/5.04 GB 2:215/4.41 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 21ms Hdfs Read Thread Concurrency Bucket: 0:99.43% 1:0.5714% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1842 BytesRead(2s000ms): 0, 0, 2.04 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 11.11 MB, 15.67 MB, 16.22 MB, 22.03 MB, 29.08 MB, 29.96 MB, 30.50 MB, 41.41 MB, 50.87 MB, 52.76 MB, 55.19 MB, 61.69 MB, 62.43 MB, 66.95 MB, 73.89 MB, 78.23 MB - FooterProcessingTime: (Avg: 4.172ms ; Min: 333.036us ; Max: 78.703ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 78.97 MB (82806419) - BytesReadDataNodeCache: 0 - BytesReadLocal: 78.97 MB (82806419) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78.97 MB (82806419) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 307.719ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10845448) - PerReadThreadRawHdfsThroughput: 459.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.598ms - RowBatchQueuePutWaitTime: 1m17s - RowsRead: 7.23M (7225691) - RowsReturned: 7.21M (7213715) - RowsReturnedRate: 24.49 M/sec - ScanRangesComplete: 1.87K (1872) - ScannerThreadsInvoluntaryContextSwitches: 468 (468) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 7s533ms - ScannerThreadsSysTime: 334.949ms - ScannerThreadsUserTime: 1s477ms - ScannerThreadsVoluntaryContextSwitches: 8.07K (8075) - TotalRawHdfsReadTime(*): 171.828ms - TotalReadThroughput: 869.52 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.50K (503496) - Rows rejected: 11.98K (11976) - Rows total: 7.23M (7225691) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 433.15K (433152) - Rows rejected: 0 (0) - Rows total: 7.21M (7213715) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1872) - Files rejected: 1.84K (1842) - Files total: 1.87K (1872) - RowGroups processed: 7.04K (7041) - RowGroups rejected: 0 (0) - RowGroups total: 7.04K (7041) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 7.21M (7213715) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:3270037300000066 (host=vc1518.foo.com:22000):(Total: 1m45s, non-child: 1m34s, % non-child: 89.27%) Hdfs split stats (:<# splits>/): -1:38/720.20 MB 0:220/4.97 GB 3:238/5.31 GB 7:209/4.43 GB 1:237/4.70 GB 2:241/4.84 GB 5:243/4.73 GB 4:223/4.60 GB 6:238/5.25 GB Filter 0 arrival: 6s325ms Filter 18 arrival: 6s724ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 7.46 MB, 8.44 MB, 8.44 MB, 13.00 MB, 17.77 MB, 38.09 MB, 36.79 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 50.51 MB, 49.80 MB, 37.07 MB, 31.04 MB, 24.82 MB, 34.60 MB, 33.61 MB, 36.73 MB, 48.05 MB, 41.30 MB, 38.47 MB, 38.00 MB, 36.38 MB, 28.09 MB, 33.04 MB, 25.41 MB, 21.83 MB, 18.85 MB, 15.50 MB, 12.40 MB, 9.80 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.82 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58532304) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 645.77 MB (677138464) - RowsProduced: 7.41M (7406162) - TotalNetworkReceiveTime: 6s228ms - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 1s459ms - TotalThreadsInvoluntaryContextSwitches: 1.96K (1956) - TotalThreadsTotalWallClockTime: 3m12s - TotalThreadsSysTime: 1s009ms - TotalThreadsUserTime: 6s730ms - TotalThreadsVoluntaryContextSwitches: 18.92K (18920) Fragment Instance Lifecycle Timings: - ExecTime: 1m38s - ExecTreeExecTime: 1s782ms - OpenTime: 6s791ms - ExecTreeOpenTime: 6s474ms - PrepareTime: 179.337ms - ExecTreePrepareTime: 23.016ms KrpcDataStreamSender (dst_id=19):(Total: 2s674ms, non-child: 2s674ms, % non-child: 100.00%) - BytesSent: 211.20 MB (221463054) - OverallThroughput: 78.96 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.41M (7406162) - RpcRetry: 0 (0) - SerializeBatchTime: 2s601ms - UncompressedRowBatchSize: 437.91 MB (459182044) CodeGen:(Total: 387.829ms, non-child: 387.829ms, % non-child: 100.00%) - CodegenTime: 2.311ms - CompileTime: 83.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 228.264ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 74.563ms HASH_JOIN_NODE (id=8):(Total: 8s290ms, non-child: 408.657ms, % non-child: 4.93%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 673.520us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.41M (7406162) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 378.314ms - RowsReturned: 7.41M (7406162) - RowsReturnedRate: 893.29 K/sec Buffer pool: - AllocTime: 8.385us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 70.711us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 247.352us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s228ms, non-child: 13.301us, % non-child: 0.00%) - ConvertRowBatchTime: 1.815us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 840.618ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s228ms - DataArrivalTimer: 6s228ms SenderSide: - DeserializeRowBatchTime: 7.424us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s654ms, non-child: 1s654ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:38/720.20 MB 0:220/4.97 GB 3:238/5.31 GB 7:209/4.43 GB 1:237/4.70 GB 2:241/4.84 GB 5:243/4.73 GB 4:223/4.60 GB 6:238/5.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:99.43% 1:0.5747% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1855 BytesRead(2s000ms): 0, 0, 0, 2.70 MB, 3.60 MB, 5.31 MB, 9.72 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 12.49 MB, 15.09 MB, 22.00 MB, 24.99 MB, 30.45 MB, 38.69 MB, 46.15 MB, 50.71 MB, 55.08 MB, 60.58 MB, 62.22 MB, 68.93 MB, 72.51 MB, 79.15 MB - FooterProcessingTime: (Avg: 20.013ms ; Min: 492.079us ; Max: 398.084ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 81.73 MB (85702849) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.73 MB (85702849) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.73 MB (85702849) - CachedFileHandlesHitCount: 192 (192) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 375.316ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10847784) - PerReadThreadRawHdfsThroughput: 483.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s122ms - RowBatchQueuePutWaitTime: 1m8s - RowsRead: 7.42M (7418933) - RowsReturned: 7.41M (7406162) - RowsReturnedRate: 4.48 M/sec - ScanRangesComplete: 1.89K (1887) - ScannerThreadsInvoluntaryContextSwitches: 556 (556) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 14s936ms - ScannerThreadsSysTime: 365.944ms - ScannerThreadsUserTime: 1s534ms - ScannerThreadsVoluntaryContextSwitches: 9.00K (9001) - TotalRawHdfsReadTime(*): 169.010ms - TotalReadThroughput: 895.12 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 537.06K (537059) - Rows rejected: 12.77K (12771) - Rows total: 7.42M (7418933) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 454.66K (454656) - Rows rejected: 0 (0) - Rows total: 7.41M (7406162) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.89K (1887) - Files rejected: 1.85K (1855) - Files total: 1.89K (1887) - RowGroups processed: 7.23K (7231) - RowGroups rejected: 0 (0) - RowGroups total: 7.23K (7231) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.41M (7406162) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:3270037300000060 (host=vc1532.foo.com:22000):(Total: 1m45s, non-child: 1m35s, % non-child: 90.45%) Hdfs split stats (:<# splits>/): 2:236/5.01 GB 4:248/5.48 GB 3:216/4.35 GB -1:43/794.41 MB 0:226/5.07 GB 7:228/4.87 GB 6:242/4.95 GB 1:224/4.82 GB 5:215/4.25 GB Filter 0 arrival: 6s243ms Filter 18 arrival: 6s807ms Filter 8 arrival: 1m3s MemoryUsage(2s000ms): 2.87 MB, 8.44 MB, 8.44 MB, 19.06 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.20 MB, 51.31 MB, 29.31 MB, 40.26 MB, 37.86 MB, 30.29 MB, 36.47 MB, 40.53 MB, 33.26 MB, 43.86 MB, 45.97 MB, 40.59 MB, 35.96 MB, 28.69 MB, 36.04 MB, 19.20 MB, 16.88 MB, 13.85 MB, 11.83 MB, 10.53 MB, 9.71 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.80 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.57 MB (58267541) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 636.14 MB (667039375) - RowsProduced: 6.32M (6322376) - TotalNetworkReceiveTime: 4s866ms - TotalNetworkSendTime: 1m18s - TotalStorageWaitTime: 302.259ms - TotalThreadsInvoluntaryContextSwitches: 1.56K (1556) - TotalThreadsTotalWallClockTime: 3m8s - TotalThreadsSysTime: 819.876ms - TotalThreadsUserTime: 5s921ms - TotalThreadsVoluntaryContextSwitches: 16.05K (16048) Fragment Instance Lifecycle Timings: - ExecTime: 1m38s - ExecTreeExecTime: 663.395ms - OpenTime: 5s339ms - ExecTreeOpenTime: 4s971ms - PrepareTime: 1s576ms - ExecTreePrepareTime: 291.625ms KrpcDataStreamSender (dst_id=19):(Total: 3s297ms, non-child: 3s297ms, % non-child: 100.00%) - BytesSent: 180.35 MB (189115823) - OverallThroughput: 54.70 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.32M (6322376) - RpcRetry: 0 (0) - SerializeBatchTime: 2s227ms - UncompressedRowBatchSize: 373.83 MB (391987312) CodeGen:(Total: 563.706ms, non-child: 563.706ms, % non-child: 100.00%) - CodegenTime: 1.342ms - CompileTime: 114.252ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 249.380ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 198.321ms HASH_JOIN_NODE (id=8):(Total: 6s207ms, non-child: 347.463ms, % non-child: 5.60%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 857.447us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.32M (6322376) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 321.602ms - RowsReturned: 6.32M (6322376) - RowsReturnedRate: 1.02 M/sec Buffer pool: - AllocTime: 34.823us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 92.546us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 486.271us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s866ms, non-child: 13.822us, % non-child: 0.00%) - ConvertRowBatchTime: 2.724us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 6.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s866ms - DataArrivalTimer: 4s866ms SenderSide: - DeserializeRowBatchTime: 17.323us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 992.807ms, non-child: 992.807ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:236/5.01 GB 4:248/5.48 GB 3:216/4.35 GB -1:43/794.41 MB 0:226/5.07 GB 7:228/4.87 GB 6:242/4.95 GB 1:224/4.82 GB 5:215/4.25 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 21ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:31 PARQUET/Unknown(Skipped):1847 BytesRead(2s000ms): 0, 0, 0, 3.31 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 11.77 MB, 15.60 MB, 25.07 MB, 31.21 MB, 35.12 MB, 39.09 MB, 40.17 MB, 44.49 MB, 51.37 MB, 57.63 MB, 58.91 MB, 62.93 MB, 64.95 MB, 68.79 MB - FooterProcessingTime: (Avg: 4.711ms ; Min: 379.538us ; Max: 45.539ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 69.88 MB (73278146) - BytesReadDataNodeCache: 0 - BytesReadLocal: 67.69 MB (70973889) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 67.69 MB (70973889) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 271.716ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.09 MB (10584456) - PerReadThreadRawHdfsThroughput: 352.34 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 81.438ms - RowBatchQueuePutWaitTime: 1m14s - RowsRead: 6.33M (6334897) - RowsReturned: 6.32M (6322376) - RowsReturnedRate: 6.37 M/sec - ScanRangesComplete: 1.88K (1878) - ScannerThreadsInvoluntaryContextSwitches: 419 (419) - ScannerThreadsTotalWallClockTime: 1m24s - MaterializeTupleTime(*): 9s094ms - ScannerThreadsSysTime: 294.955ms - ScannerThreadsUserTime: 1s301ms - ScannerThreadsVoluntaryContextSwitches: 7.24K (7236) - TotalRawHdfsReadTime(*): 198.340ms - TotalReadThroughput: 777.83 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 520.42K (520425) - Rows rejected: 12.52K (12521) - Rows total: 6.33M (6334897) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 430.08K (430080) - Rows rejected: 0 (0) - Rows total: 6.32M (6322376) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1878) - Files rejected: 1.85K (1847) - Files total: 1.88K (1878) - RowGroups processed: 6.17K (6171) - RowGroups rejected: 0 (0) - RowGroups total: 6.17K (6171) - Rows processed: 507.90K (507904) - Rows rejected: 0 (0) - Rows total: 6.32M (6322376) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance b04615c310d227c4:3270037300000055 (host=vc1508.foo.com:22000):(Total: 1m44s, non-child: 1m34s, % non-child: 90.06%) Hdfs split stats (:<# splits>/): 3:234/4.49 GB 4:223/4.64 GB -1:24/642.17 MB 0:218/4.93 GB 5:220/4.29 GB 7:245/5.37 GB 6:242/5.22 GB 1:234/4.69 GB 2:249/5.32 GB Filter 0 arrival: 4s253ms Filter 18 arrival: 6s599ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 6.97 MB, 8.44 MB, 8.45 MB, 18.73 MB, 36.67 MB, 32.66 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 53.17 MB, 52.80 MB, 52.30 MB, 35.55 MB, 43.41 MB, 29.10 MB, 38.55 MB, 41.13 MB, 33.50 MB, 35.34 MB, 31.76 MB, 22.20 MB, 31.68 MB, 37.91 MB, 35.07 MB, 33.87 MB, 29.50 MB, 39.42 MB, 37.32 MB, 31.09 MB, 26.61 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.75 MB (58463263) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 651.79 MB (683449175) - RowsProduced: 7.11M (7114818) - TotalNetworkReceiveTime: 5s852ms - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 316.245ms - TotalThreadsInvoluntaryContextSwitches: 2.14K (2138) - TotalThreadsTotalWallClockTime: 3m12s - TotalThreadsSysTime: 970.851ms - TotalThreadsUserTime: 6s980ms - TotalThreadsVoluntaryContextSwitches: 20.05K (20052) Fragment Instance Lifecycle Timings: - ExecTime: 1m38s - ExecTreeExecTime: 747.155ms - OpenTime: 6s442ms - ExecTreeOpenTime: 6s085ms - PrepareTime: 390.720ms - ExecTreePrepareTime: 38.655ms KrpcDataStreamSender (dst_id=19):(Total: 2s984ms, non-child: 2s984ms, % non-child: 100.00%) - BytesSent: 202.93 MB (212787717) - OverallThroughput: 67.99 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.11M (7114818) - RpcRetry: 0 (0) - SerializeBatchTime: 2s847ms - UncompressedRowBatchSize: 420.68 MB (441118716) CodeGen:(Total: 555.621ms, non-child: 555.621ms, % non-child: 100.00%) - CodegenTime: 2.541ms - CompileTime: 105.714ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 240.295ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 204.725ms HASH_JOIN_NODE (id=8):(Total: 6s896ms, non-child: 422.382ms, % non-child: 6.12%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 685.829us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.11M (7114818) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 389.732ms - RowsReturned: 7.11M (7114818) - RowsReturnedRate: 1.03 M/sec Buffer pool: - AllocTime: 14.847us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 108.300us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 309.442us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 5s852ms, non-child: 15.906us, % non-child: 0.00%) - ConvertRowBatchTime: 2.456us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 5.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 585.611ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 5s852ms - DataArrivalTimer: 5s852ms SenderSide: - DeserializeRowBatchTime: 7.123us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 621.312ms, non-child: 621.312ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:234/4.49 GB 4:223/4.64 GB -1:24/642.17 MB 0:218/4.93 GB 5:220/4.29 GB 7:245/5.37 GB 6:242/5.22 GB 1:234/4.69 GB 2:249/5.32 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:33 PARQUET/Unknown(Skipped):1856 BytesRead(2s000ms): 0, 0, 0, 2.22 MB, 6.66 MB, 9.63 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 11.84 MB, 13.83 MB, 21.98 MB, 23.88 MB, 31.49 MB, 36.39 MB, 45.86 MB, 50.80 MB, 56.82 MB, 58.10 MB, 61.00 MB, 66.20 MB, 68.38 MB, 72.20 MB, 77.35 MB - FooterProcessingTime: (Avg: 4.639ms ; Min: 348.403us ; Max: 68.595ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 78.50 MB (82313625) - BytesReadDataNodeCache: 0 - BytesReadLocal: 78.50 MB (82313625) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 78.50 MB (82313625) - CachedFileHandlesHitCount: 198 (198) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 365.614ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10838327) - PerReadThreadRawHdfsThroughput: 415.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 332.953ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 7.13M (7127930) - RowsReturned: 7.11M (7114818) - RowsReturnedRate: 11.45 M/sec - ScanRangesComplete: 1.89K (1889) - ScannerThreadsInvoluntaryContextSwitches: 608 (608) - ScannerThreadsTotalWallClockTime: 1m27s - MaterializeTupleTime(*): 14s100ms - ScannerThreadsSysTime: 322.950ms - ScannerThreadsUserTime: 1s558ms - ScannerThreadsVoluntaryContextSwitches: 9.23K (9232) - TotalRawHdfsReadTime(*): 188.767ms - TotalReadThroughput: 846.15 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 553.78K (553784) - Rows rejected: 13.11K (13112) - Rows total: 7.13M (7127930) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 467.97K (467968) - Rows rejected: 0 (0) - Rows total: 7.11M (7114818) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.89K (1889) - Files rejected: 1.86K (1856) - Files total: 1.89K (1889) - RowGroups processed: 6.95K (6945) - RowGroups rejected: 0 (0) - RowGroups total: 6.95K (6945) - Rows processed: 540.67K (540672) - Rows rejected: 0 (0) - Rows total: 7.11M (7114818) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance b04615c310d227c4:327003730000006e (host=vc1528.foo.com:22000):(Total: 1m44s, non-child: 1m34s, % non-child: 90.41%) Hdfs split stats (:<# splits>/): -1:45/801.88 MB 0:223/4.67 GB 5:237/5.07 GB 7:248/5.56 GB 2:243/4.93 GB 6:225/4.95 GB 3:255/5.18 GB 1:172/3.46 GB 4:236/4.94 GB Filter 0 arrival: 6s011ms Filter 18 arrival: 6s607ms Filter 8 arrival: 1m3s MemoryUsage(2s000ms): 7.46 MB, 8.44 MB, 8.44 MB, 20.80 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.94 MB, 54.01 MB, 54.07 MB, 30.43 MB, 31.33 MB, 32.39 MB, 43.44 MB, 51.34 MB, 28.88 MB, 30.72 MB, 38.82 MB, 38.97 MB, 30.30 MB, 23.16 MB, 21.93 MB, 29.78 MB, 34.86 MB, 27.89 MB, 25.39 MB, 23.13 MB, 20.39 MB, 12.17 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.82 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.81 MB (58519786) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 651.63 MB (683288267) - RowsProduced: 7.15M (7145093) - TotalNetworkReceiveTime: 6s104ms - TotalNetworkSendTime: 1m13s - TotalStorageWaitTime: 183.988ms - TotalThreadsInvoluntaryContextSwitches: 1.74K (1740) - TotalThreadsTotalWallClockTime: 3m9s - TotalThreadsSysTime: 917.860ms - TotalThreadsUserTime: 6s546ms - TotalThreadsVoluntaryContextSwitches: 17.91K (17914) Fragment Instance Lifecycle Timings: - ExecTime: 1m37s - ExecTreeExecTime: 602.589ms - OpenTime: 6s496ms - ExecTreeOpenTime: 6s173ms - PrepareTime: 175.556ms - ExecTreePrepareTime: 23.586ms KrpcDataStreamSender (dst_id=19):(Total: 2s783ms, non-child: 2s783ms, % non-child: 100.00%) - BytesSent: 203.77 MB (213663668) - OverallThroughput: 73.21 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.15M (7145093) - RpcRetry: 0 (0) - SerializeBatchTime: 2s721ms - UncompressedRowBatchSize: 422.47 MB (442995766) CodeGen:(Total: 396.828ms, non-child: 396.828ms, % non-child: 100.00%) - CodegenTime: 2.719ms - CompileTime: 81.075ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 238.165ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 75.474ms HASH_JOIN_NODE (id=8):(Total: 6s812ms, non-child: 392.596ms, % non-child: 5.76%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 5.063ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.15M (7145093) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 358.279ms - RowsReturned: 7.15M (7145093) - RowsReturnedRate: 1.05 M/sec Buffer pool: - AllocTime: 4.229ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 4.326ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 330.184us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s104ms, non-child: 17.679us, % non-child: 0.00%) - ConvertRowBatchTime: 2.124us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 325.781ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s104ms - DataArrivalTimer: 6s104ms SenderSide: - DeserializeRowBatchTime: 9.285us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 315.203ms, non-child: 315.203ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): -1:45/801.88 MB 0:223/4.67 GB 5:237/5.07 GB 7:248/5.56 GB 2:243/4.93 GB 6:225/4.95 GB 3:255/5.18 GB 1:172/3.46 GB 4:236/4.94 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1852 BytesRead(2s000ms): 0, 0, 0, 4.03 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 10.98 MB, 13.90 MB, 25.19 MB, 31.70 MB, 41.28 MB, 44.39 MB, 45.55 MB, 51.22 MB, 59.88 MB, 68.26 MB, 73.50 MB, 77.57 MB, 78.31 MB, 78.31 MB - FooterProcessingTime: (Avg: 1.247ms ; Min: 427.575us ; Max: 11.435ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 78.31 MB (82109744) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.86 MB (80597899) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.86 MB (80597899) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 255.338ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10846967) - PerReadThreadRawHdfsThroughput: 321.33 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 41.904ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 7.16M (7157938) - RowsReturned: 7.15M (7145093) - RowsReturnedRate: 22.67 M/sec - ScanRangesComplete: 1.88K (1884) - ScannerThreadsInvoluntaryContextSwitches: 495 (495) - ScannerThreadsTotalWallClockTime: 1m25s - MaterializeTupleTime(*): 10s600ms - ScannerThreadsSysTime: 312.952ms - ScannerThreadsUserTime: 1s468ms - ScannerThreadsVoluntaryContextSwitches: 8.57K (8571) - TotalRawHdfsReadTime(*): 243.693ms - TotalReadThroughput: 871.58 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 537.13K (537133) - Rows rejected: 12.85K (12845) - Rows total: 7.16M (7157938) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 464.90K (464896) - Rows rejected: 0 (0) - Rows total: 7.15M (7145093) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1884) - Files rejected: 1.85K (1852) - Files total: 1.88K (1884) - RowGroups processed: 6.97K (6974) - RowGroups rejected: 0 (0) - RowGroups total: 6.97K (6974) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.15M (7145093) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:3270037300000051 (host=vc1533.foo.com:22000):(Total: 1m44s, non-child: 1m39s, % non-child: 95.57%) Hdfs split stats (:<# splits>/): 5:254/5.54 GB -1:25/501.60 MB 0:203/4.32 GB 3:234/5.24 GB 2:237/4.86 GB 6:229/4.72 GB 4:218/4.38 GB 1:209/4.90 GB 7:255/5.11 GB Filter 18 arrival: 1s445ms Filter 0 arrival: 6s630ms Filter 8 arrival: 1m3s MemoryUsage(2s000ms): 19.01 MB, 50.12 MB, 45.19 MB, 36.84 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.19 MB, 53.22 MB, 53.32 MB, 40.77 MB, 42.60 MB, 34.55 MB, 29.84 MB, 32.00 MB, 28.31 MB, 29.47 MB, 40.34 MB, 38.51 MB, 34.31 MB, 34.62 MB, 27.62 MB, 52.02 MB, 38.47 MB, 21.96 MB, 25.69 MB, 20.10 MB, 12.78 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.81 MB (58525339) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 634.06 MB (664860327) - RowsProduced: 7.49M (7489668) - TotalNetworkReceiveTime: 790.152ms - TotalNetworkSendTime: 1m14s - TotalStorageWaitTime: 141.693ms - TotalThreadsInvoluntaryContextSwitches: 2.01K (2007) - TotalThreadsTotalWallClockTime: 3m18s - TotalThreadsSysTime: 1s015ms - TotalThreadsUserTime: 7s036ms - TotalThreadsVoluntaryContextSwitches: 21.21K (21207) Fragment Instance Lifecycle Timings: - ExecTime: 1m42s - ExecTreeExecTime: 581.967ms - OpenTime: 1s221ms - ExecTreeOpenTime: 851.180ms - PrepareTime: 284.342ms - ExecTreePrepareTime: 38.971ms KrpcDataStreamSender (dst_id=19):(Total: 2s635ms, non-child: 2s635ms, % non-child: 100.00%) - BytesSent: 213.72 MB (224097168) - OverallThroughput: 81.10 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 7.49M (7489668) - RpcRetry: 0 (0) - SerializeBatchTime: 2s518ms - UncompressedRowBatchSize: 442.85 MB (464359416) CodeGen:(Total: 471.668ms, non-child: 471.668ms, % non-child: 100.00%) - CodegenTime: 2.160ms - CompileTime: 127.101ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 235.651ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 104.417ms HASH_JOIN_NODE (id=8):(Total: 1s497ms, non-child: 432.349ms, % non-child: 28.86%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 702.723us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 7.49M (7489668) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 396.980ms - RowsReturned: 7.49M (7489668) - RowsReturnedRate: 5.00 M/sec Buffer pool: - AllocTime: 14.553us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 123.682us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 258.368us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 790.161ms, non-child: 18.354us, % non-child: 0.00%) - ConvertRowBatchTime: 1.846us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 37.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B - FirstBatchArrivalWaitTime: 741.841ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 790.149ms - DataArrivalTimer: 790.144ms SenderSide: - DeserializeRowBatchTime: 6.140us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 275.341ms, non-child: 275.341ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:254/5.54 GB -1:25/501.60 MB 0:203/4.32 GB 3:234/5.24 GB 2:237/4.86 GB 6:229/4.72 GB 4:218/4.38 GB 1:209/4.90 GB 7:255/5.11 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: Not all filters arrived (arrived: [18], missing [0, 8]), waited for 41ms Hdfs Read Thread Concurrency Bucket: 0:99.47% 1:0.5291% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:32 PARQUET/Unknown(Skipped):1832 BytesRead(2s000ms): 1.66 MB, 11.92 MB, 11.92 MB, 17.67 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 20.80 MB, 27.56 MB, 33.35 MB, 39.41 MB, 46.71 MB, 53.48 MB, 56.66 MB, 56.69 MB, 62.65 MB, 68.09 MB, 73.99 MB, 78.71 MB, 80.16 MB, 81.31 MB, 82.46 MB - FooterProcessingTime: (Avg: 1.078ms ; Min: 288.095us ; Max: 11.549ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 82.46 MB (86469319) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.24 MB (84137680) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.24 MB (84137680) - CachedFileHandlesHitCount: 186 (186) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 338.416ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10873077) - PerReadThreadRawHdfsThroughput: 387.38 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 12.717ms - RowBatchQueuePutWaitTime: 1m18s - RowsRead: 7.50M (7500300) - RowsReturned: 7.49M (7489668) - RowsReturnedRate: 27.20 M/sec - ScanRangesComplete: 1.86K (1864) - ScannerThreadsInvoluntaryContextSwitches: 549 (549) - ScannerThreadsTotalWallClockTime: 1m34s - MaterializeTupleTime(*): 15s196ms - ScannerThreadsSysTime: 358.945ms - ScannerThreadsUserTime: 1s591ms - ScannerThreadsVoluntaryContextSwitches: 9.91K (9913) - TotalRawHdfsReadTime(*): 212.872ms - TotalReadThroughput: 879.61 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 440.71K (440712) - Rows rejected: 10.63K (10632) - Rows total: 7.50M (7500300) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 380.93K (380928) - Rows rejected: 0 (0) - Rows total: 7.49M (7489668) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.86K (1864) - Files rejected: 1.83K (1832) - Files total: 1.86K (1864) - RowGroups processed: 7.31K (7313) - RowGroups rejected: 0 (0) - RowGroups total: 7.31K (7313) - Rows processed: 524.29K (524288) - Rows rejected: 0 (0) - Rows total: 7.49M (7489668) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance b04615c310d227c4:3270037300000063 (host=vc1502.foo.com:22000):(Total: 1m41s, non-child: 1m30s, % non-child: 89.46%) Hdfs split stats (:<# splits>/): 5:231/4.95 GB 7:227/4.92 GB 6:204/4.26 GB 1:241/5.15 GB 4:244/5.02 GB 2:219/5.03 GB 3:238/5.14 GB -1:30/597.53 MB 0:234/4.52 GB Filter 0 arrival: 4s168ms Filter 18 arrival: 7s040ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 7.46 MB, 8.44 MB, 8.45 MB, 16.99 MB, 29.83 MB, 31.29 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.79 MB, 52.92 MB, 50.70 MB, 35.43 MB, 39.39 MB, 47.39 MB, 40.93 MB, 40.87 MB, 40.58 MB, 42.73 MB, 34.99 MB, 35.23 MB, 28.00 MB, 21.48 MB, 36.44 MB, 29.99 MB, 28.91 MB, 22.00 MB, 13.95 MB, 12.83 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.69 MB (58392718) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 638.07 MB (669062694) - RowsProduced: 6.93M (6926525) - TotalNetworkReceiveTime: 6s235ms - TotalNetworkSendTime: 1m11s - TotalStorageWaitTime: 585.712ms - TotalThreadsInvoluntaryContextSwitches: 1.90K (1896) - TotalThreadsTotalWallClockTime: 3m7s - TotalThreadsSysTime: 981.850ms - TotalThreadsUserTime: 6s814ms - TotalThreadsVoluntaryContextSwitches: 19.45K (19448) Fragment Instance Lifecycle Timings: - ExecTime: 1m34s - ExecTreeExecTime: 762.163ms - OpenTime: 6s777ms - ExecTreeOpenTime: 6s313ms - PrepareTime: 332.806ms - ExecTreePrepareTime: 20.996ms KrpcDataStreamSender (dst_id=19):(Total: 2s969ms, non-child: 2s969ms, % non-child: 100.00%) - BytesSent: 197.63 MB (207231598) - OverallThroughput: 66.56 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.93M (6926525) - RpcRetry: 0 (0) - SerializeBatchTime: 2s834ms - UncompressedRowBatchSize: 409.55 MB (429444550) CodeGen:(Total: 602.146ms, non-child: 602.146ms, % non-child: 100.00%) - CodegenTime: 2.880ms - CompileTime: 139.887ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 310.616ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 138.248ms HASH_JOIN_NODE (id=8):(Total: 7s104ms, non-child: 407.565ms, % non-child: 5.74%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 8.545ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.93M (6926525) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 368.237ms - RowsReturned: 6.93M (6926525) - RowsReturnedRate: 974.93 K/sec Buffer pool: - AllocTime: 7.737ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.455ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 721.919us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s235ms, non-child: 17.162us, % non-child: 0.00%) - ConvertRowBatchTime: 2.138us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 456.156ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s235ms - DataArrivalTimer: 6s235ms SenderSide: - DeserializeRowBatchTime: 17.825us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 461.978ms, non-child: 461.978ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:231/4.95 GB 7:227/4.92 GB 6:204/4.26 GB 1:241/5.15 GB 4:244/5.02 GB 2:219/5.03 GB 3:238/5.14 GB -1:30/597.53 MB 0:234/4.52 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1838 BytesRead(2s000ms): 0, 0, 0, 1.69 MB, 7.39 MB, 9.53 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 11.78 MB, 13.59 MB, 24.01 MB, 26.26 MB, 28.50 MB, 31.47 MB, 37.00 MB, 41.25 MB, 49.13 MB, 56.94 MB, 62.74 MB, 63.81 MB, 68.52 MB, 72.84 MB - FooterProcessingTime: (Avg: 12.123ms ; Min: 401.012us ; Max: 172.052ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 76.04 MB (79729551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.04 MB (79729551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.04 MB (79729551) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 284.061ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10875962) - PerReadThreadRawHdfsThroughput: 457.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 212.013ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 6.94M (6938420) - RowsReturned: 6.93M (6926525) - RowsReturnedRate: 14.99 M/sec - ScanRangesComplete: 1.87K (1868) - ScannerThreadsInvoluntaryContextSwitches: 567 (567) - ScannerThreadsTotalWallClockTime: 1m26s - MaterializeTupleTime(*): 11s382ms - ScannerThreadsSysTime: 315.951ms - ScannerThreadsUserTime: 1s534ms - ScannerThreadsVoluntaryContextSwitches: 8.89K (8889) - TotalRawHdfsReadTime(*): 166.080ms - TotalReadThroughput: 832.74 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.42K (503415) - Rows rejected: 11.89K (11895) - Rows total: 6.94M (6938420) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 420.86K (420864) - Rows rejected: 0 (0) - Rows total: 6.93M (6926525) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.87K (1868) - Files rejected: 1.84K (1838) - Files total: 1.87K (1868) - RowGroups processed: 6.76K (6762) - RowGroups rejected: 0 (0) - RowGroups total: 6.76K (6762) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 6.93M (6926525) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:3270037300000056 (host=vc1522.foo.com:22000):(Total: 1m40s, non-child: 1m29s, % non-child: 88.95%) Hdfs split stats (:<# splits>/): 3:223/5.03 GB 7:239/5.31 GB 4:227/4.92 GB 2:223/4.79 GB 5:211/4.48 GB 6:243/4.73 GB 1:228/4.68 GB -1:37/741.27 MB 0:233/4.90 GB Filter 0 arrival: 6s376ms Filter 18 arrival: 7s138ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 6.97 MB, 8.44 MB, 8.44 MB, 9.16 MB, 25.75 MB, 42.17 MB, 40.93 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.16 MB, 53.23 MB, 52.79 MB, 36.80 MB, 50.47 MB, 30.56 MB, 31.53 MB, 42.20 MB, 29.02 MB, 41.09 MB, 46.25 MB, 27.32 MB, 21.98 MB, 33.84 MB, 32.00 MB, 20.92 MB, 15.27 MB, 12.81 MB, 11.45 MB, 11.02 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.83 MB (58537695) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 620.70 MB (650848615) - RowsProduced: 6.87M (6874144) - TotalNetworkReceiveTime: 6s443ms - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 313.866ms - TotalThreadsInvoluntaryContextSwitches: 1.88K (1875) - TotalThreadsTotalWallClockTime: 3m3s - TotalThreadsSysTime: 902.862ms - TotalThreadsUserTime: 6s425ms - TotalThreadsVoluntaryContextSwitches: 18.73K (18734) Fragment Instance Lifecycle Timings: - ExecTime: 1m32s - ExecTreeExecTime: 584.158ms - OpenTime: 7s529ms - ExecTreeOpenTime: 7s149ms - PrepareTime: 313.410ms - ExecTreePrepareTime: 26.142ms KrpcDataStreamSender (dst_id=19):(Total: 2s764ms, non-child: 2s764ms, % non-child: 100.00%) - BytesSent: 196.20 MB (205733576) - OverallThroughput: 70.97 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.87M (6874144) - RpcRetry: 0 (0) - SerializeBatchTime: 2s668ms - UncompressedRowBatchSize: 406.45 MB (426196928) CodeGen:(Total: 526.940ms, non-child: 526.940ms, % non-child: 100.00%) - CodegenTime: 3.838ms - CompileTime: 114.656ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 234.953ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 175.497ms HASH_JOIN_NODE (id=8):(Total: 7s773ms, non-child: 379.294ms, % non-child: 4.88%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 543.686us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.87M (6874144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 349.431ms - RowsReturned: 6.87M (6874144) - RowsReturnedRate: 884.32 K/sec Buffer pool: - AllocTime: 9.059us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 73.773us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 226.896us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s443ms, non-child: 16.264us, % non-child: 0.00%) - ConvertRowBatchTime: 2.329us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 646.241ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s443ms - DataArrivalTimer: 6s443ms SenderSide: - DeserializeRowBatchTime: 7.948us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 950.319ms, non-child: 950.319ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:223/5.03 GB 7:239/5.31 GB 4:227/4.92 GB 2:223/4.79 GB 5:211/4.48 GB 6:243/4.73 GB 1:228/4.68 GB -1:37/741.27 MB 0:233/4.90 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:30 PARQUET/Unknown(Skipped):1834 BytesRead(2s000ms): 0, 0, 0, 560.75 KB, 3.68 MB, 6.69 MB, 9.45 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 11.10 MB, 12.59 MB, 24.42 MB, 27.38 MB, 30.47 MB, 40.58 MB, 45.26 MB, 53.74 MB, 57.62 MB, 62.98 MB, 63.54 MB, 69.00 MB, 73.26 MB - FooterProcessingTime: (Avg: 4.609ms ; Min: 478.567us ; Max: 60.045ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 76.18 MB (79880970) - BytesReadDataNodeCache: 0 - BytesReadLocal: 76.18 MB (79880970) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 76.18 MB (79880970) - CachedFileHandlesHitCount: 180 (180) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 277.959ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.34 MB (10846256) - PerReadThreadRawHdfsThroughput: 416.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 658.833ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 6.89M (6885981) - RowsReturned: 6.87M (6874144) - RowsReturnedRate: 7.23 M/sec - ScanRangesComplete: 1.86K (1864) - ScannerThreadsInvoluntaryContextSwitches: 519 (519) - ScannerThreadsTotalWallClockTime: 1m23s - MaterializeTupleTime(*): 11s591ms - ScannerThreadsSysTime: 317.951ms - ScannerThreadsUserTime: 1s415ms - ScannerThreadsVoluntaryContextSwitches: 8.74K (8745) - TotalRawHdfsReadTime(*): 182.927ms - TotalReadThroughput: 857.24 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 503.36K (503357) - Rows rejected: 11.84K (11837) - Rows total: 6.89M (6885981) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 416.77K (416768) - Rows rejected: 0 (0) - Rows total: 6.87M (6874144) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.86K (1864) - Files rejected: 1.83K (1834) - Files total: 1.86K (1864) - RowGroups processed: 6.71K (6711) - RowGroups rejected: 0 (0) - RowGroups total: 6.71K (6711) - Rows processed: 491.52K (491520) - Rows rejected: 0 (0) - Rows total: 6.87M (6874144) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance b04615c310d227c4:3270037300000053 (host=vc1504.foo.com:22000):(Total: 1m39s, non-child: 1m28s, % non-child: 89.34%) Hdfs split stats (:<# splits>/): 6:222/4.84 GB -1:25/627.37 MB 0:208/4.29 GB 3:231/4.63 GB 2:228/4.99 GB 1:219/5.21 GB 4:237/4.89 GB 7:249/4.95 GB 5:243/5.15 GB Filter 0 arrival: 3s363ms Filter 18 arrival: 6s273ms Filter 8 arrival: 1m1s MemoryUsage(2s000ms): 5.66 MB, 8.44 MB, 8.45 MB, 26.10 MB, 50.90 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.69 MB, 55.76 MB, 55.82 MB, 55.32 MB, 41.28 MB, 31.21 MB, 38.90 MB, 35.24 MB, 34.06 MB, 29.22 MB, 38.34 MB, 32.03 MB, 37.25 MB, 30.93 MB, 34.06 MB, 36.62 MB, 23.52 MB, 18.14 MB, 15.72 MB, 12.39 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58529034) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 655.38 MB (687211985) - RowsProduced: 6.48M (6484987) - TotalNetworkReceiveTime: 4s934ms - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 141.861ms - TotalThreadsInvoluntaryContextSwitches: 2.04K (2041) - TotalThreadsTotalWallClockTime: 3m3s - TotalThreadsSysTime: 1s021ms - TotalThreadsUserTime: 6s758ms - TotalThreadsVoluntaryContextSwitches: 19.87K (19872) Fragment Instance Lifecycle Timings: - ExecTime: 1m33s - ExecTreeExecTime: 565.461ms - OpenTime: 5s523ms - ExecTreeOpenTime: 5s114ms - PrepareTime: 879.748ms - ExecTreePrepareTime: 54.251ms KrpcDataStreamSender (dst_id=19):(Total: 4s151ms, non-child: 4s151ms, % non-child: 100.00%) - BytesSent: 185.11 MB (194097433) - OverallThroughput: 44.59 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.48M (6484987) - RpcRetry: 0 (0) - SerializeBatchTime: 3s646ms - UncompressedRowBatchSize: 383.44 MB (402069194) CodeGen:(Total: 687.522ms, non-child: 687.522ms, % non-child: 100.00%) - CodegenTime: 4.068ms - CompileTime: 143.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 244.846ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 290.807ms HASH_JOIN_NODE (id=8):(Total: 5s773ms, non-child: 469.200ms, % non-child: 8.13%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 49.648ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.48M (6484987) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 387.403ms - RowsReturned: 6.48M (6484987) - RowsReturnedRate: 1.12 M/sec Buffer pool: - AllocTime: 48.841ms - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.968ms - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 355.156us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 4s934ms, non-child: 14.362us, % non-child: 0.00%) - ConvertRowBatchTime: 2.342us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 6.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 0.000ns - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 4s934ms - DataArrivalTimer: 4s934ms SenderSide: - DeserializeRowBatchTime: 4.232us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 370.070ms, non-child: 370.070ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:222/4.84 GB -1:25/627.37 MB 0:208/4.29 GB 3:231/4.63 GB 2:228/4.99 GB 1:219/5.21 GB 4:237/4.89 GB 7:249/4.95 GB 5:243/5.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:28 PARQUET/Unknown(Skipped):1834 BytesRead(2s000ms): 0, 0, 0, 4.66 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 11.27 MB, 15.93 MB, 23.97 MB, 30.99 MB, 37.34 MB, 41.27 MB, 42.87 MB, 47.95 MB, 53.10 MB, 58.45 MB, 63.20 MB, 70.00 MB, 71.46 MB - FooterProcessingTime: (Avg: 2.284ms ; Min: 330.161us ; Max: 19.817ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 71.46 MB (74928660) - BytesReadDataNodeCache: 0 - BytesReadLocal: 71.46 MB (74928660) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 71.46 MB (74928660) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 345.098ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.35 MB (10847720) - PerReadThreadRawHdfsThroughput: 459.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.686ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 6.50M (6496312) - RowsReturned: 6.48M (6484987) - RowsReturnedRate: 17.52 M/sec - ScanRangesComplete: 1.86K (1862) - ScannerThreadsInvoluntaryContextSwitches: 583 (583) - ScannerThreadsTotalWallClockTime: 1m24s - MaterializeTupleTime(*): 13s137ms - ScannerThreadsSysTime: 320.951ms - ScannerThreadsUserTime: 1s477ms - ScannerThreadsVoluntaryContextSwitches: 8.64K (8636) - TotalRawHdfsReadTime(*): 155.652ms - TotalReadThroughput: 786.80 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 470.08K (470077) - Rows rejected: 11.32K (11325) - Rows total: 6.50M (6496312) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 395.26K (395264) - Rows rejected: 0 (0) - Rows total: 6.48M (6484987) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.86K (1862) - Files rejected: 1.83K (1834) - Files total: 1.86K (1862) - RowGroups processed: 6.33K (6332) - RowGroups rejected: 0 (0) - RowGroups total: 6.33K (6332) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 6.48M (6484987) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance b04615c310d227c4:3270037300000054 (host=vc1505.foo.com:22000):(Total: 1m34s, non-child: 1m23s, % non-child: 88.59%) Hdfs split stats (:<# splits>/): 7:217/4.44 GB 2:243/5.27 GB 4:228/4.95 GB 5:229/4.65 GB 6:241/4.80 GB -1:37/695.09 MB 0:225/4.58 GB 1:242/5.13 GB 3:221/5.05 GB Filter 0 arrival: 4s240ms Filter 18 arrival: 7s099ms Filter 8 arrival: 1m2s MemoryUsage(2s000ms): 7.34 MB, 8.44 MB, 8.45 MB, 18.50 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 54.91 MB, 55.03 MB, 55.03 MB, 44.46 MB, 28.06 MB, 28.91 MB, 39.59 MB, 43.00 MB, 39.59 MB, 33.63 MB, 34.06 MB, 38.40 MB, 39.40 MB, 32.69 MB, 41.57 MB, 20.64 MB, 18.64 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 144.00 KB (147456) - PeakMemoryUsage: 55.82 MB (58531154) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 606.58 MB (636042469) - RowsProduced: 6.72M (6723422) - TotalNetworkReceiveTime: 6s515ms - TotalNetworkSendTime: 1m9s - TotalStorageWaitTime: 150.042ms - TotalThreadsInvoluntaryContextSwitches: 1.61K (1614) - TotalThreadsTotalWallClockTime: 2m55s - TotalThreadsSysTime: 884.865ms - TotalThreadsUserTime: 6s114ms - TotalThreadsVoluntaryContextSwitches: 16.24K (16238) Fragment Instance Lifecycle Timings: - ExecTime: 1m27s - ExecTreeExecTime: 437.835ms - OpenTime: 6s918ms - ExecTreeOpenTime: 6s564ms - PrepareTime: 230.019ms - ExecTreePrepareTime: 27.357ms KrpcDataStreamSender (dst_id=19):(Total: 3s250ms, non-child: 3s250ms, % non-child: 100.00%) - BytesSent: 191.82 MB (201135597) - OverallThroughput: 59.01 MB/sec - PeakMemoryUsage: 43.29 MB (45392784) - RowsReturned: 6.72M (6723422) - RpcRetry: 0 (0) - SerializeBatchTime: 3s157ms - UncompressedRowBatchSize: 397.54 MB (416852164) CodeGen:(Total: 446.503ms, non-child: 446.503ms, % non-child: 100.00%) - CodegenTime: 1.534ms - CompileTime: 95.107ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 91 (91) - NumInstructions: 3.00K (2999) - OptimizationTime: 255.871ms - PeakMemoryUsage: 1.46 MB (1535488) - PrepareTime: 94.185ms HASH_JOIN_NODE (id=8):(Total: 7s045ms, non-child: 366.449ms, % non-child: 5.20%) ExecOption: Probe Side Codegen Enabled - BuildRows: 30 (30) - BuildTime: 650.078us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.03 MB (2126080) - ProbeRows: 6.72M (6723422) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 338.166ms - RowsReturned: 6.72M (6723422) - RowsReturnedRate: 954.23 K/sec Buffer pool: - AllocTime: 10.481us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=8): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 86.893us - BuildRowsPartitioned: 30 (30) - HashBuckets: 52 (52) - HashCollisions: 0 (0) - HashTablesBuildTime: 242.290us - LargestPartitionPercent: 10 (10) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=17):(Total: 6s515ms, non-child: 36.389us, % non-child: 0.00%) - ConvertRowBatchTime: 2.061us - PeakMemoryUsage: 0 - RowsReturned: 30 (30) - RowsReturnedRate: 4.00 /sec RecvrSide: BytesReceived(500.000ms): 0, 0, 0, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B, 630.00 B - FirstBatchArrivalWaitTime: 736.549ms - TotalBytesReceived: 630.00 B (630) - TotalGetBatchTime: 6s515ms - DataArrivalTimer: 6s515ms SenderSide: - DeserializeRowBatchTime: 8.603us - NumBatchesAccepted: 1 (1) - NumBatchesDeferred: 0 (0) - NumEarlySenders: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 164.364ms, non-child: 164.364ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:217/4.44 GB 2:243/5.27 GB 4:228/4.95 GB 5:229/4.65 GB 6:241/4.80 GB -1:37/695.09 MB 0:225/4.58 GB 1:242/5.13 GB 3:221/5.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29 Runtime filters: Not all filters arrived (arrived: [0, 18], missing [8]), waited for 20ms Hdfs Read Thread Concurrency Bucket: 0:99.39% 1:0.6135% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:29 PARQUET/Unknown(Skipped):1854 BytesRead(2s000ms): 0, 0, 0, 3.42 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 12.16 MB, 14.33 MB, 20.84 MB, 30.34 MB, 36.15 MB, 46.27 MB, 48.40 MB, 52.31 MB, 57.24 MB, 63.14 MB, 69.72 MB - FooterProcessingTime: (Avg: 1.382ms ; Min: 493.364us ; Max: 7.468ms ; Number of samples: 29) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 73.15 MB (76700821) - BytesReadDataNodeCache: 0 - BytesReadLocal: 70.95 MB (74395756) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 70.95 MB (74395756) - CachedFileHandlesHitCount: 168 (168) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DecompressionTime: 211.382ms - MaxCompressedTextFileLength: 0 - NumColumns: 5 (5) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 9 (9) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 10.37 MB (10874272) - PerReadThreadRawHdfsThroughput: 363.17 MB/sec - RemoteScanRanges: 18 (18) - RowBatchQueueGetWaitTime: 16.275ms - RowBatchQueuePutWaitTime: 1m13s - RowsRead: 6.73M (6734849) - RowsReturned: 6.72M (6723422) - RowsReturnedRate: 40.91 M/sec - ScanRangesComplete: 1.88K (1883) - ScannerThreadsInvoluntaryContextSwitches: 469 (469) - ScannerThreadsTotalWallClockTime: 1m21s - MaterializeTupleTime(*): 6s819ms - ScannerThreadsSysTime: 285.956ms - ScannerThreadsUserTime: 1s398ms - ScannerThreadsVoluntaryContextSwitches: 7.81K (7812) - TotalRawHdfsReadTime(*): 201.411ms - TotalReadThroughput: 846.36 KB/sec Filter 0 (8.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 486.56K (486563) - Rows rejected: 11.43K (11427) - Rows total: 6.73M (6734849) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 8 (128.00 KB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 408.58K (408576) - Rows rejected: 0 (0) - Rows total: 6.72M (6723422) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) Filter 18 (8.00 KB): - Files processed: 1.88K (1883) - Files rejected: 1.85K (1854) - Files total: 1.88K (1883) - RowGroups processed: 6.56K (6564) - RowGroups rejected: 0 (0) - RowGroups total: 6.56K (6564) - Rows processed: 475.14K (475136) - Rows rejected: 0 (0) - Rows total: 6.72M (6723422) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Averaged Fragment F03:(Total: 6s785ms, non-child: 5s806ms, % non-child: 85.57%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:6s979ms max:6s979ms mean: 6s979ms stddev:0.000ns execution rates: min:315.63 KB/sec max:315.63 KB/sec mean:315.63 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.18 MB (12774029) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 30 (30) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s777ms - TotalStorageWaitTime: 2.704ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 6s102ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 220 (220) Fragment Instance Lifecycle Timings: - ExecTime: 5s837ms - ExecTreeExecTime: 58.594ms - OpenTime: 207.298ms - ExecTreeOpenTime: 66.687us - PrepareTime: 740.963ms - ExecTreePrepareTime: 136.214us KrpcDataStreamSender (dst_id=17):(Total: 252.268ms, non-child: 252.268ms, % non-child: 100.00%) - BytesSent: 254.00 B (254) - OverallThroughput: 1006.00 B/sec - PeakMemoryUsage: 11.38 MB (11937384) - RowsReturned: 30 (30) - RpcRetry: 0 (0) - SerializeBatchTime: 18.580us - UncompressedRowBatchSize: 630.00 B (630) CodeGen:(Total: 667.867ms, non-child: 667.867ms, % non-child: 100.00%) - CodegenTime: 2.348ms - CompileTime: 47.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 32 (32) - NumInstructions: 521 (521) - OptimizationTime: 129.600ms - PeakMemoryUsage: 260.50 KB (266752) - PrepareTime: 467.039ms HDFS_SCAN_NODE (id=3):(Total: 58.974ms, non-child: 58.974ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.739ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 808.28 KB (827678) - PerReadThreadRawHdfsThroughput: 170.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.469ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 30 (30) - RowsReturnedRate: 508.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 58.107ms - MaterializeTupleTime(*): 2.290ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 30 (30) - TotalRawHdfsReadTime(*): 2.666ms - TotalReadThroughput: 0.00 /sec Fragment F03: Instance b04615c310d227c4:327003730000004b (host=vc1515.foo.com:22000):(Total: 6s785ms, non-child: 5s806ms, % non-child: 85.57%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB MemoryUsage(500.000ms): 11.38 MB, 11.65 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.18 MB (12774029) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 30 (30) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s777ms - TotalStorageWaitTime: 2.704ms - TotalThreadsInvoluntaryContextSwitches: 18 (18) - TotalThreadsTotalWallClockTime: 6s102ms - TotalThreadsSysTime: 5.998ms - TotalThreadsUserTime: 63.990ms - TotalThreadsVoluntaryContextSwitches: 220 (220) Fragment Instance Lifecycle Timings: - ExecTime: 5s837ms - ExecTreeExecTime: 58.594ms - OpenTime: 207.298ms - ExecTreeOpenTime: 66.687us - PrepareTime: 740.963ms - ExecTreePrepareTime: 136.214us KrpcDataStreamSender (dst_id=17):(Total: 252.268ms, non-child: 252.268ms, % non-child: 100.00%) - BytesSent: 254.00 B (254) - OverallThroughput: 1006.00 B/sec - PeakMemoryUsage: 11.38 MB (11937384) - RowsReturned: 30 (30) - RpcRetry: 0 (0) - SerializeBatchTime: 18.580us - UncompressedRowBatchSize: 630.00 B (630) CodeGen:(Total: 667.867ms, non-child: 667.867ms, % non-child: 100.00%) - CodegenTime: 2.348ms - CompileTime: 47.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 32 (32) - NumInstructions: 521 (521) - OptimizationTime: 129.600ms - PeakMemoryUsage: 260.50 KB (266752) - PrepareTime: 467.039ms HDFS_SCAN_NODE (id=3):(Total: 58.974ms, non-child: 58.974ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 732.072us ; Min: 732.072us ; Max: 732.072us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.739ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 808.28 KB (827678) - PerReadThreadRawHdfsThroughput: 170.50 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.469ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 30 (30) - RowsReturnedRate: 508.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 58.107ms - MaterializeTupleTime(*): 2.290ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 30 (30) - TotalRawHdfsReadTime(*): 2.666ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F05:(Total: 5s315ms, non-child: 4s294ms, % non-child: 80.79%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:5s500ms max:5s500ms mean: 5s500ms stddev:0.000ns execution rates: min:400.51 KB/sec max:400.51 KB/sec mean:400.51 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.18 MB (12774125) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 122 (122) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s243ms - TotalStorageWaitTime: 2.075ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 4s540ms - TotalThreadsSysTime: 8.999ms - TotalThreadsUserTime: 66.990ms - TotalThreadsVoluntaryContextSwitches: 185 (185) Fragment Instance Lifecycle Timings: - ExecTime: 4s341ms - ExecTreeExecTime: 56.735ms - OpenTime: 148.573ms - ExecTreeOpenTime: 135.416us - PrepareTime: 825.203ms - ExecTreePrepareTime: 79.194us KrpcDataStreamSender (dst_id=20):(Total: 274.347ms, non-child: 274.347ms, % non-child: 100.00%) - BytesSent: 1010.00 B (1010) - OverallThroughput: 3.59 KB/sec - PeakMemoryUsage: 11.38 MB (11937384) - RowsReturned: 122 (122) - RpcRetry: 0 (0) - SerializeBatchTime: 27.043us - UncompressedRowBatchSize: 2.50 KB (2562) CodeGen:(Total: 689.785ms, non-child: 689.785ms, % non-child: 100.00%) - CodegenTime: 3.258ms - CompileTime: 55.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 573 (573) - OptimizationTime: 70.107ms - PeakMemoryUsage: 286.50 KB (293376) - PrepareTime: 463.342ms HDFS_SCAN_NODE (id=4):(Total: 57.044ms, non-child: 57.044ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7.693ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 808.28 KB (827678) - PerReadThreadRawHdfsThroughput: 217.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.371ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 122 (122) - RowsReturnedRate: 2.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 50.072ms - MaterializeTupleTime(*): 1.046ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 2.093ms - TotalReadThroughput: 0.00 /sec Fragment F05: Instance b04615c310d227c4:3270037300000071 (host=vc1515.foo.com:22000):(Total: 5s315ms, non-child: 4s294ms, % non-child: 80.79%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB MemoryUsage(500.000ms): 11.38 MB, 11.67 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB, 11.40 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.18 MB (12774125) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 122 (122) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s243ms - TotalStorageWaitTime: 2.075ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 4s540ms - TotalThreadsSysTime: 8.999ms - TotalThreadsUserTime: 66.990ms - TotalThreadsVoluntaryContextSwitches: 185 (185) Fragment Instance Lifecycle Timings: - ExecTime: 4s341ms - ExecTreeExecTime: 56.735ms - OpenTime: 148.573ms - ExecTreeOpenTime: 135.416us - PrepareTime: 825.203ms - ExecTreePrepareTime: 79.194us KrpcDataStreamSender (dst_id=20):(Total: 274.347ms, non-child: 274.347ms, % non-child: 100.00%) - BytesSent: 1010.00 B (1010) - OverallThroughput: 3.59 KB/sec - PeakMemoryUsage: 11.38 MB (11937384) - RowsReturned: 122 (122) - RpcRetry: 0 (0) - SerializeBatchTime: 27.043us - UncompressedRowBatchSize: 2.50 KB (2562) CodeGen:(Total: 689.785ms, non-child: 689.785ms, % non-child: 100.00%) - CodegenTime: 3.258ms - CompileTime: 55.362ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 35 (35) - NumInstructions: 573 (573) - OptimizationTime: 70.107ms - PeakMemoryUsage: 286.50 KB (293376) - PrepareTime: 463.342ms HDFS_SCAN_NODE (id=4):(Total: 57.044ms, non-child: 57.044ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 4.761ms ; Min: 4.761ms ; Max: 4.761ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.57 KB (476741) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.57 KB (476741) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.57 KB (476741) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 7.693ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 808.28 KB (827678) - PerReadThreadRawHdfsThroughput: 217.21 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 35.371ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 122 (122) - RowsReturnedRate: 2.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 50.072ms - MaterializeTupleTime(*): 1.046ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsReadTime(*): 2.093ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F06:(Total: 34s550ms, non-child: 32s668ms, % non-child: 94.55%) split sizes: min: 961.80 KB, max: 7.25 MB, avg: 3.77 MB, stddev: 1.25 MB completion times: min:14s171ms max:1m5s mean: 34s758ms stddev:11s636ms execution rates: min:67.87 KB/sec max:162.50 KB/sec mean:111.81 KB/sec stddev:22.63 KB/sec num instances: 13 - AverageThreadTokens: 1.01 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.29 MB (11842729) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 418.05 MB (438354395) - RowsProduced: 30.92K (30923) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s229ms - TotalStorageWaitTime: 3.833ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 33s458ms - TotalThreadsSysTime: 19.996ms - TotalThreadsUserTime: 122.442ms - TotalThreadsVoluntaryContextSwitches: 915 (915) Fragment Instance Lifecycle Timings: - ExecTime: 32s960ms - ExecTreeExecTime: 211.334ms - OpenTime: 173.656ms - ExecTreeOpenTime: 80.159us - PrepareTime: 1s416ms - ExecTreePrepareTime: 167.679us KrpcDataStreamSender (dst_id=21):(Total: 1s174ms, non-child: 1s174ms, % non-child: 100.00%) - BytesSent: 2.89 MB (3026856) - OverallThroughput: 7.80 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.92K (30923) - RpcRetry: 0 (0) - SerializeBatchTime: 93.554ms - UncompressedRowBatchSize: 4.87 MB (5110522) CodeGen:(Total: 494.834ms, non-child: 494.834ms, % non-child: 100.00%) - CodegenTime: 995.544us - CompileTime: 60.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 80.613ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 328.930ms HDFS_SCAN_NODE (id=7):(Total: 211.661ms, non-child: 211.661ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.49 MB (2609678) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.49 MB (2609678) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.49 MB (2609678) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 19.317ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.64 MB (8007367) - PerReadThreadRawHdfsThroughput: 527.73 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 202.410ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.92K (30923) - RowsReturned: 30.92K (30923) - RowsReturnedRate: 217.73 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 324.946ms - MaterializeTupleTime(*): 106.359ms - ScannerThreadsSysTime: 7.613ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 97 (97) - TotalRawHdfsReadTime(*): 6.238ms - TotalReadThroughput: 83.40 KB/sec Fragment F06: Instance b04615c310d227c4:327003730000007a (host=vc1502.foo.com:22000):(Total: 1m5s, non-child: 1m5s, % non-child: 99.12%) Hdfs split stats (:<# splits>/): 1:1/7.25 MB MemoryUsage(2s000ms): 11.00 MB, 13.43 MB, 13.34 MB, 13.23 MB, 13.09 MB, 12.84 MB, 12.73 MB, 12.62 MB, 12.54 MB, 12.48 MB, 12.38 MB, 12.26 MB, 12.07 MB, 11.97 MB, 11.90 MB, 11.84 MB, 11.78 MB, 11.73 MB, 11.65 MB, 11.15 MB, 10.64 MB, 10.28 MB, 10.07 MB, 9.82 MB, 9.62 MB, 9.35 MB, 9.08 MB, 8.90 MB, 8.82 MB, 8.73 MB, 7.32 MB, 3.62 MB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 18.49 MB (19384358) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 417.26 MB (437529610) - RowsProduced: 60.72K (60722) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m3s - TotalStorageWaitTime: 1.598ms - TotalThreadsInvoluntaryContextSwitches: 27 (27) - TotalThreadsTotalWallClockTime: 1m5s - TotalThreadsSysTime: 46.992ms - TotalThreadsUserTime: 204.968ms - TotalThreadsVoluntaryContextSwitches: 1.72K (1722) Fragment Instance Lifecycle Timings: - ExecTime: 1m5s - ExecTreeExecTime: 120.861ms - OpenTime: 107.246ms - ExecTreeOpenTime: 64.641us - PrepareTime: 256.555ms - ExecTreePrepareTime: 167.116us KrpcDataStreamSender (dst_id=21):(Total: 225.051ms, non-child: 225.051ms, % non-child: 100.00%) - BytesSent: 5.67 MB (5940585) - OverallThroughput: 25.17 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 60.72K (60722) - RpcRetry: 0 (0) - SerializeBatchTime: 96.603ms - UncompressedRowBatchSize: 9.57 MB (10031938) CodeGen:(Total: 233.447ms, non-child: 233.447ms, % non-child: 100.00%) - CodegenTime: 886.476us - CompileTime: 45.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 52.910ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 108.367ms HDFS_SCAN_NODE (id=7):(Total: 121.021ms, non-child: 121.021ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/7.25 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(1s000ms): 2.36 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB, 4.72 MB - FooterProcessingTime: (Avg: 783.976us ; Min: 783.976us ; Max: 783.976us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.72 MB (4954430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.72 MB (4954430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.72 MB (4954430) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 20.250ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 14.83 MB (15548996) - PerReadThreadRawHdfsThroughput: 693.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 117.005ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 60.72K (60722) - RowsReturned: 60.72K (60722) - RowsReturnedRate: 501.75 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 182.014ms - MaterializeTupleTime(*): 35.116ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 164 (164) - TotalRawHdfsReadTime(*): 6.816ms - TotalReadThroughput: 78.67 KB/sec Instance b04615c310d227c4:3270037300000073 (host=vc1503.foo.com:22000):(Total: 44s373ms, non-child: 43s941ms, % non-child: 99.03%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB MemoryUsage(1s000ms): 5.67 MB, 8.52 MB, 8.47 MB, 8.47 MB, 8.47 MB, 8.44 MB, 8.40 MB, 8.37 MB, 8.35 MB, 8.30 MB, 8.28 MB, 8.23 MB, 8.20 MB, 8.16 MB, 8.11 MB, 8.04 MB, 7.99 MB, 7.99 MB, 7.94 MB, 7.94 MB, 7.94 MB, 7.92 MB, 7.89 MB, 7.89 MB, 7.87 MB, 7.82 MB, 7.77 MB, 7.73 MB, 7.65 MB, 7.58 MB, 7.56 MB, 7.51 MB, 7.46 MB, 7.44 MB, 7.37 MB, 7.32 MB, 7.27 MB, 7.27 MB, 7.22 MB, 7.20 MB, 5.40 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11717027) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 372.39 MB (390480095) - RowsProduced: 30.30K (30297) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43s849ms - TotalStorageWaitTime: 1.511ms - TotalThreadsInvoluntaryContextSwitches: 22 (22) - TotalThreadsTotalWallClockTime: 44s248ms - TotalThreadsSysTime: 12.998ms - TotalThreadsUserTime: 127.980ms - TotalThreadsVoluntaryContextSwitches: 1.08K (1085) Fragment Instance Lifecycle Timings: - ExecTime: 44s078ms - ExecTreeExecTime: 83.881ms - OpenTime: 64.547ms - ExecTreeOpenTime: 85.427us - PrepareTime: 230.833ms - ExecTreePrepareTime: 152.005us KrpcDataStreamSender (dst_id=21):(Total: 182.637ms, non-child: 182.637ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2969373) - OverallThroughput: 15.51 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.30K (30297) - RpcRetry: 0 (0) - SerializeBatchTime: 54.285ms - UncompressedRowBatchSize: 4.78 MB (5016192) CodeGen:(Total: 165.413ms, non-child: 165.413ms, % non-child: 100.00%) - CodegenTime: 837.232us - CompileTime: 15.923ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 45.461ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 102.353ms HDFS_SCAN_NODE (id=7):(Total: 84.181ms, non-child: 84.181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(1s000ms): 1.23 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 836.414us ; Min: 836.414us ; Max: 836.414us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.45 MB (2570468) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2570468) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2570468) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 929.038us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.52 MB (7881665) - PerReadThreadRawHdfsThroughput: 566.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 82.765ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.30K (30297) - RowsReturned: 30.30K (30297) - RowsReturnedRate: 359.90 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 105.426ms - MaterializeTupleTime(*): 14.831ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 87 (87) - TotalRawHdfsReadTime(*): 4.326ms - TotalReadThroughput: 61.98 KB/sec Instance b04615c310d227c4:327003730000007d (host=vc1540.foo.com:22000):(Total: 42s158ms, non-child: 41s513ms, % non-child: 98.47%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB MemoryUsage(1s000ms): 7.59 MB, 8.51 MB, 8.51 MB, 8.46 MB, 8.44 MB, 8.39 MB, 8.32 MB, 8.27 MB, 8.25 MB, 8.20 MB, 8.13 MB, 8.06 MB, 7.99 MB, 7.89 MB, 7.84 MB, 7.79 MB, 7.79 MB, 7.72 MB, 7.70 MB, 7.67 MB, 7.65 MB, 7.65 MB, 7.65 MB, 7.60 MB, 7.60 MB, 7.55 MB, 7.48 MB, 7.43 MB, 7.41 MB, 7.36 MB, 7.29 MB, 7.27 MB, 7.22 MB, 7.20 MB, 7.17 MB, 5.39 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.01 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11713410) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 426.25 MB (446954562) - RowsProduced: 30.37K (30373) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 41s347ms - TotalStorageWaitTime: 1.497ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 42s100ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 120.981ms - TotalThreadsVoluntaryContextSwitches: 1.06K (1060) Fragment Instance Lifecycle Timings: - ExecTime: 41s812ms - ExecTreeExecTime: 177.958ms - OpenTime: 64.999ms - ExecTreeOpenTime: 44.076us - PrepareTime: 281.433ms - ExecTreePrepareTime: 254.701us KrpcDataStreamSender (dst_id=21):(Total: 302.266ms, non-child: 302.266ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2969888) - OverallThroughput: 9.37 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.37K (30373) - RpcRetry: 0 (0) - SerializeBatchTime: 123.399ms - UncompressedRowBatchSize: 4.78 MB (5016556) CodeGen:(Total: 164.848ms, non-child: 164.848ms, % non-child: 100.00%) - CodegenTime: 856.337us - CompileTime: 18.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 41.958ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 101.825ms HDFS_SCAN_NODE (id=7):(Total: 178.555ms, non-child: 178.555ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(1s000ms): 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 742.765us ; Min: 742.765us ; Max: 742.765us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.01 - BytesRead: 2.45 MB (2567053) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2567053) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2567053) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.469ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7878048) - PerReadThreadRawHdfsThroughput: 557.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 161.627ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.37K (30373) - RowsReturned: 30.37K (30373) - RowsReturnedRate: 170.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 222.922ms - MaterializeTupleTime(*): 46.396ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 94 (94) - TotalRawHdfsReadTime(*): 4.388ms - TotalReadThroughput: 70.62 KB/sec Instance b04615c310d227c4:3270037300000075 (host=vc1532.foo.com:22000):(Total: 37s021ms, non-child: 35s295ms, % non-child: 95.34%) Hdfs split stats (:<# splits>/): 7:1/3.71 MB MemoryUsage(1s000ms): 499.49 KB, 5.99 MB, 8.51 MB, 8.51 MB, 8.49 MB, 8.46 MB, 8.42 MB, 8.37 MB, 8.34 MB, 8.27 MB, 8.22 MB, 8.15 MB, 8.08 MB, 7.99 MB, 7.94 MB, 7.89 MB, 7.89 MB, 7.87 MB, 7.84 MB, 7.79 MB, 7.77 MB, 7.72 MB, 7.70 MB, 7.65 MB, 7.53 MB, 7.46 MB, 7.41 MB, 7.29 MB, 7.22 MB, 7.22 MB, 7.17 MB, 5.39 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.01 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11713460) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 417.71 MB (437995844) - RowsProduced: 30.36K (30362) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34s953ms - TotalStorageWaitTime: 1.260ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 35s531ms - TotalThreadsSysTime: 20.997ms - TotalThreadsUserTime: 113.982ms - TotalThreadsVoluntaryContextSwitches: 913 (913) Fragment Instance Lifecycle Timings: - ExecTime: 35s400ms - ExecTreeExecTime: 52.428ms - OpenTime: 63.843ms - ExecTreeOpenTime: 87.795us - PrepareTime: 1s557ms - ExecTreePrepareTime: 176.300us KrpcDataStreamSender (dst_id=21):(Total: 1s408ms, non-child: 1s408ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2971493) - OverallThroughput: 2.01 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.36K (30362) - RpcRetry: 0 (0) - SerializeBatchTime: 58.583ms - UncompressedRowBatchSize: 4.78 MB (5013071) CodeGen:(Total: 264.125ms, non-child: 264.125ms, % non-child: 100.00%) - CodegenTime: 1.218ms - CompileTime: 32.844ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 22.482ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 189.715ms HDFS_SCAN_NODE (id=7):(Total: 52.800ms, non-child: 52.800ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 801.751us ; Min: 801.751us ; Max: 801.751us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.45 MB (2570156) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2570156) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2570156) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6.736ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7878098) - PerReadThreadRawHdfsThroughput: 715.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.267ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.36K (30362) - RowsReturned: 30.36K (30362) - RowsReturnedRate: 575.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 67.463ms - MaterializeTupleTime(*): 15.256ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 24.996ms - ScannerThreadsVoluntaryContextSwitches: 70 (70) - TotalRawHdfsReadTime(*): 3.426ms - TotalReadThroughput: 79.68 KB/sec Instance b04615c310d227c4:327003730000007b (host=vc1517.foo.com:22000):(Total: 35s994ms, non-child: 34s880ms, % non-child: 96.90%) Hdfs split stats (:<# splits>/): 5:1/3.71 MB MemoryUsage(1s000ms): 1.17 MB, 9.60 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.46 MB, 8.46 MB, 8.42 MB, 8.37 MB, 8.25 MB, 8.15 MB, 8.10 MB, 7.98 MB, 7.82 MB, 7.75 MB, 7.75 MB, 7.72 MB, 7.70 MB, 7.67 MB, 7.65 MB, 7.60 MB, 7.60 MB, 7.60 MB, 7.58 MB, 7.55 MB, 7.53 MB, 7.51 MB, 7.48 MB, 7.43 MB, 7.36 MB, 7.27 MB, 7.20 MB, 7.17 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.01 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11712850) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 429.93 MB (450818594) - RowsProduced: 30.38K (30380) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33s918ms - TotalStorageWaitTime: 1.424ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 35s383ms - TotalThreadsSysTime: 16.997ms - TotalThreadsUserTime: 125.980ms - TotalThreadsVoluntaryContextSwitches: 961 (961) Fragment Instance Lifecycle Timings: - ExecTime: 35s122ms - ExecTreeExecTime: 139.767ms - OpenTime: 85.568ms - ExecTreeOpenTime: 54.777us - PrepareTime: 786.353ms - ExecTreePrepareTime: 129.352us KrpcDataStreamSender (dst_id=21):(Total: 711.880ms, non-child: 711.880ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2968765) - OverallThroughput: 3.98 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.38K (30380) - RpcRetry: 0 (0) - SerializeBatchTime: 104.900ms - UncompressedRowBatchSize: 4.78 MB (5015005) CodeGen:(Total: 262.587ms, non-child: 262.587ms, % non-child: 100.00%) - CodegenTime: 1.332ms - CompileTime: 9.627ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 31.203ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 219.790ms HDFS_SCAN_NODE (id=7):(Total: 139.920ms, non-child: 139.920ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(1s000ms): 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 711.057us ; Min: 711.057us ; Max: 711.057us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.45 MB (2568999) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2568999) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2568999) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 15.862ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7877488) - PerReadThreadRawHdfsThroughput: 503.76 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 125.887ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.38K (30380) - RowsReturned: 30.38K (30380) - RowsReturnedRate: 217.12 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 175.736ms - MaterializeTupleTime(*): 48.227ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 75 (75) - TotalRawHdfsReadTime(*): 4.863ms - TotalReadThroughput: 76.02 KB/sec Instance b04615c310d227c4:327003730000007e (host=vc1525.foo.com:22000):(Total: 33s740ms, non-child: 32s974ms, % non-child: 97.73%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB MemoryUsage(1s000ms): 6.06 MB, 8.52 MB, 8.49 MB, 8.47 MB, 8.47 MB, 8.40 MB, 8.30 MB, 8.25 MB, 8.23 MB, 8.20 MB, 8.16 MB, 8.08 MB, 8.01 MB, 7.99 MB, 7.97 MB, 7.94 MB, 7.94 MB, 7.92 MB, 7.87 MB, 7.80 MB, 7.68 MB, 7.61 MB, 7.58 MB, 7.56 MB, 7.49 MB, 7.41 MB, 7.41 MB, 7.37 MB, 7.34 MB, 7.27 MB, 7.20 MB, 5.40 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11716990) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 431.61 MB (452580834) - RowsProduced: 30.30K (30304) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s586ms - TotalStorageWaitTime: 1.387ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 33s645ms - TotalThreadsSysTime: 18.997ms - TotalThreadsUserTime: 114.982ms - TotalThreadsVoluntaryContextSwitches: 923 (923) Fragment Instance Lifecycle Timings: - ExecTime: 33s275ms - ExecTreeExecTime: 154.095ms - OpenTime: 107.576ms - ExecTreeOpenTime: 87.157us - PrepareTime: 357.964ms - ExecTreePrepareTime: 159.929us KrpcDataStreamSender (dst_id=21):(Total: 301.081ms, non-child: 301.081ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2970639) - OverallThroughput: 9.41 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.30K (30304) - RpcRetry: 0 (0) - SerializeBatchTime: 153.648ms - UncompressedRowBatchSize: 4.79 MB (5017539) CodeGen:(Total: 311.066ms, non-child: 311.066ms, % non-child: 100.00%) - CodegenTime: 693.949us - CompileTime: 42.301ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 33.592ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 221.631ms HDFS_SCAN_NODE (id=7):(Total: 154.369ms, non-child: 154.369ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 594.134us ; Min: 594.134us ; Max: 594.134us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.45 MB (2570667) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2570667) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2570667) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 46.363ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.52 MB (7881628) - PerReadThreadRawHdfsThroughput: 519.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 153.254ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.30K (30304) - RowsReturned: 30.30K (30304) - RowsReturnedRate: 196.31 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 262.718ms - MaterializeTupleTime(*): 89.988ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 91 (91) - TotalRawHdfsReadTime(*): 4.718ms - TotalReadThroughput: 79.70 KB/sec Instance b04615c310d227c4:3270037300000072 (host=vc1509.foo.com:22000):(Total: 32s175ms, non-child: 25s930ms, % non-child: 80.59%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB MemoryUsage(1s000ms): 1.85 MB, 2.49 MB, 2.78 MB, 3.37 MB, 3.61 MB, 6.62 MB, 9.82 MB, 8.47 MB, 8.37 MB, 8.18 MB, 8.09 MB, 8.01 MB, 7.92 MB, 7.87 MB, 7.82 MB, 7.77 MB, 7.75 MB, 7.75 MB, 7.70 MB, 7.66 MB, 7.56 MB, 7.49 MB, 7.42 MB, 7.37 MB, 7.27 MB, 7.22 MB, 7.18 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 MB (11718254) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 441.28 MB (462710928) - RowsProduced: 30.27K (30272) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25s501ms - TotalStorageWaitTime: 1.561ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 27s978ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 116.982ms - TotalThreadsVoluntaryContextSwitches: 859 (859) Fragment Instance Lifecycle Timings: - ExecTime: 26s580ms - ExecTreeExecTime: 577.495ms - OpenTime: 491.732ms - ExecTreeOpenTime: 94.919us - PrepareTime: 5s103ms - ExecTreePrepareTime: 178.191us KrpcDataStreamSender (dst_id=21):(Total: 4s192ms, non-child: 4s192ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2971519) - OverallThroughput: 692.21 KB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.27K (30272) - RpcRetry: 0 (0) - SerializeBatchTime: 126.981ms - UncompressedRowBatchSize: 4.78 MB (5010688) CodeGen:(Total: 1s475ms, non-child: 1s475ms, % non-child: 100.00%) - CodegenTime: 1.260ms - CompileTime: 207.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 190.560ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 1s032ms HDFS_SCAN_NODE (id=7):(Total: 577.861ms, non-child: 577.861ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 810.897us ; Min: 810.897us ; Max: 810.897us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.05 - BytesRead: 2.45 MB (2572228) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2572228) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2572228) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 27.422ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.52 MB (7882892) - PerReadThreadRawHdfsThroughput: 534.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 556.044ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.27K (30272) - RowsReturned: 30.27K (30272) - RowsReturnedRate: 52.39 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 906.660ms - MaterializeTupleTime(*): 369.079ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 154 (154) - TotalRawHdfsReadTime(*): 4.585ms - TotalReadThroughput: 93.03 KB/sec Instance b04615c310d227c4:327003730000007c (host=vc1507.foo.com:22000):(Total: 31s727ms, non-child: 28s135ms, % non-child: 88.68%) Hdfs split stats (:<# splits>/): 7:1/3.71 MB MemoryUsage(1s000ms): 1.22 MB, 2.49 MB, 3.56 MB, 6.80 MB, 8.52 MB, 8.47 MB, 8.42 MB, 8.37 MB, 8.30 MB, 8.25 MB, 8.18 MB, 8.13 MB, 8.09 MB, 8.06 MB, 8.01 MB, 7.99 MB, 7.94 MB, 7.94 MB, 7.89 MB, 7.82 MB, 7.73 MB, 7.70 MB, 7.63 MB, 7.56 MB, 7.49 MB, 7.44 MB, 7.42 MB, 7.37 MB, 7.30 MB, 7.25 MB, 7.18 MB, 3.62 MB ThreadUsage(1s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.18 MB (11718102) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 435.30 MB (456442002) - RowsProduced: 30.28K (30280) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s558ms - TotalStorageWaitTime: 1.912ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 29s390ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 122.981ms - TotalThreadsVoluntaryContextSwitches: 850 (850) Fragment Instance Lifecycle Timings: - ExecTime: 28s519ms - ExecTreeExecTime: 299.208ms - OpenTime: 291.381ms - ExecTreeOpenTime: 69.668us - PrepareTime: 2s915ms - ExecTreePrepareTime: 159.805us KrpcDataStreamSender (dst_id=21):(Total: 2s166ms, non-child: 2s166ms, % non-child: 100.00%) - BytesSent: 2.84 MB (2975909) - OverallThroughput: 1.31 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.28K (30280) - RpcRetry: 0 (0) - SerializeBatchTime: 126.485ms - UncompressedRowBatchSize: 4.79 MB (5019594) CodeGen:(Total: 1s125ms, non-child: 1s125ms, % non-child: 100.00%) - CodegenTime: 479.303us - CompileTime: 62.841ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 157.613ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 745.286ms HDFS_SCAN_NODE (id=7):(Total: 299.479ms, non-child: 299.479ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 1.022ms ; Min: 1.022ms ; Max: 1.022ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.45 MB (2569090) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2569090) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2569090) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 13.892ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.52 MB (7882740) - PerReadThreadRawHdfsThroughput: 443.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 297.906ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.28K (30280) - RowsReturned: 30.28K (30280) - RowsReturnedRate: 101.11 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 579.437ms - MaterializeTupleTime(*): 251.955ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 104 (104) - TotalRawHdfsReadTime(*): 5.525ms - TotalReadThroughput: 80.93 KB/sec Instance b04615c310d227c4:3270037300000078 (host=vc1513.foo.com:22000):(Total: 31s224ms, non-child: 30s439ms, % non-child: 97.49%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB MemoryUsage(500.000ms): 3.62 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.42 MB, 8.37 MB, 8.32 MB, 8.27 MB, 8.22 MB, 8.22 MB, 8.18 MB, 8.18 MB, 8.13 MB, 8.13 MB, 8.08 MB, 8.08 MB, 8.08 MB, 8.03 MB, 7.98 MB, 7.94 MB, 7.89 MB, 7.79 MB, 7.75 MB, 7.75 MB, 7.70 MB, 7.70 MB, 7.65 MB, 7.65 MB, 7.65 MB, 7.65 MB, 7.60 MB, 7.60 MB, 7.60 MB, 7.55 MB, 7.51 MB, 7.46 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.36 MB, 7.36 MB, 7.31 MB, 7.31 MB, 7.27 MB, 7.27 MB, 7.27 MB, 7.22 MB, 7.22 MB, 7.17 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11712906) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 426.85 MB (447580889) - RowsProduced: 30.37K (30369) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s164ms - TotalStorageWaitTime: 2.043ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 31s226ms - TotalThreadsSysTime: 17.997ms - TotalThreadsUserTime: 123.981ms - TotalThreadsVoluntaryContextSwitches: 881 (881) Fragment Instance Lifecycle Timings: - ExecTime: 30s740ms - ExecTreeExecTime: 222.775ms - OpenTime: 214.118ms - ExecTreeOpenTime: 122.583us - PrepareTime: 269.277ms - ExecTreePrepareTime: 142.044us KrpcDataStreamSender (dst_id=21):(Total: 164.549ms, non-child: 164.549ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2969162) - OverallThroughput: 17.21 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.37K (30369) - RpcRetry: 0 (0) - SerializeBatchTime: 79.600ms - UncompressedRowBatchSize: 4.78 MB (5012667) CodeGen:(Total: 396.756ms, non-child: 396.756ms, % non-child: 100.00%) - CodegenTime: 1.268ms - CompileTime: 96.882ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 113.559ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 184.490ms HDFS_SCAN_NODE (id=7):(Total: 223.068ms, non-child: 223.068ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 782.595us ; Min: 782.595us ; Max: 782.595us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.45 MB (2568878) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2568878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2568878) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 11.679ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7877544) - PerReadThreadRawHdfsThroughput: 535.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 208.228ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.37K (30369) - RowsReturned: 30.37K (30369) - RowsReturnedRate: 136.14 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 271.867ms - MaterializeTupleTime(*): 71.005ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 27.995ms - ScannerThreadsVoluntaryContextSwitches: 106 (106) - TotalRawHdfsReadTime(*): 4.575ms - TotalReadThroughput: 89.59 KB/sec Instance b04615c310d227c4:3270037300000074 (host=vc1524.foo.com:22000):(Total: 30s026ms, non-child: 27s935ms, % non-child: 93.04%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB MemoryUsage(500.000ms): 699.29 KB, 1.17 MB, 3.61 MB, 3.62 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.46 MB, 8.46 MB, 8.42 MB, 8.37 MB, 8.32 MB, 8.27 MB, 8.27 MB, 8.22 MB, 8.22 MB, 8.18 MB, 8.13 MB, 8.08 MB, 8.03 MB, 8.03 MB, 7.99 MB, 7.99 MB, 7.94 MB, 7.84 MB, 7.79 MB, 7.79 MB, 7.75 MB, 7.75 MB, 7.70 MB, 7.70 MB, 7.70 MB, 7.70 MB, 7.65 MB, 7.65 MB, 7.65 MB, 7.60 MB, 7.60 MB, 7.56 MB, 7.51 MB, 7.51 MB, 7.46 MB, 7.41 MB, 7.41 MB, 7.36 MB, 7.32 MB, 7.32 MB, 7.27 MB, 7.27 MB, 7.27 MB, 7.22 MB, 7.17 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(500.000ms): 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11713935) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 430.01 MB (450893717) - RowsProduced: 30.36K (30365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s761ms - TotalStorageWaitTime: 5.927ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 28s682ms - TotalThreadsSysTime: 16.996ms - TotalThreadsUserTime: 117.982ms - TotalThreadsVoluntaryContextSwitches: 780 (780) Fragment Instance Lifecycle Timings: - ExecTime: 28s279ms - ExecTreeExecTime: 267.580ms - OpenTime: 90.974ms - ExecTreeOpenTime: 56.673us - PrepareTime: 1s656ms - ExecTreePrepareTime: 116.653us KrpcDataStreamSender (dst_id=21):(Total: 1s338ms, non-child: 1s338ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2970579) - OverallThroughput: 2.12 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.36K (30365) - RpcRetry: 0 (0) - SerializeBatchTime: 83.449ms - UncompressedRowBatchSize: 4.79 MB (5018189) CodeGen:(Total: 484.580ms, non-child: 484.580ms, % non-child: 100.00%) - CodegenTime: 1.272ms - CompileTime: 19.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 37.318ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 418.879ms HDFS_SCAN_NODE (id=7):(Total: 267.759ms, non-child: 267.759ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 0, 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 3.022ms ; Min: 3.022ms ; Max: 3.022ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.45 MB (2564706) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2564706) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2564706) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5.281ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7878573) - PerReadThreadRawHdfsThroughput: 627.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 240.999ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.36K (30365) - RowsReturned: 30.36K (30365) - RowsReturnedRate: 113.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 312.325ms - MaterializeTupleTime(*): 58.322ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 88 (88) - TotalRawHdfsReadTime(*): 3.896ms - TotalReadThroughput: 92.76 KB/sec Instance b04615c310d227c4:3270037300000076 (host=vc1538.foo.com:22000):(Total: 28s199ms, non-child: 27s510ms, % non-child: 97.55%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB MemoryUsage(500.000ms): 2.24 MB, 9.85 MB, 8.51 MB, 8.51 MB, 8.51 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.46 MB, 8.41 MB, 8.41 MB, 8.37 MB, 8.32 MB, 8.32 MB, 8.27 MB, 8.27 MB, 8.27 MB, 8.22 MB, 8.22 MB, 8.13 MB, 8.13 MB, 8.08 MB, 7.98 MB, 7.94 MB, 7.89 MB, 7.89 MB, 7.89 MB, 7.89 MB, 7.84 MB, 7.79 MB, 7.79 MB, 7.74 MB, 7.74 MB, 7.74 MB, 7.74 MB, 7.70 MB, 7.60 MB, 7.60 MB, 7.60 MB, 7.55 MB, 7.51 MB, 7.51 MB, 7.51 MB, 7.46 MB, 7.41 MB, 7.31 MB, 7.27 MB, 7.22 MB, 7.17 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.17 MB (11712165) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 428.05 MB (448845244) - RowsProduced: 30.40K (30401) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27s134ms - TotalStorageWaitTime: 26.551ms - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 28s099ms - TotalThreadsSysTime: 20.996ms - TotalThreadsUserTime: 123.981ms - TotalThreadsVoluntaryContextSwitches: 778 (778) Fragment Instance Lifecycle Timings: - ExecTime: 27s732ms - ExecTreeExecTime: 149.615ms - OpenTime: 162.561ms - ExecTreeOpenTime: 88.000us - PrepareTime: 304.210ms - ExecTreePrepareTime: 124.892us KrpcDataStreamSender (dst_id=21):(Total: 219.308ms, non-child: 219.308ms, % non-child: 100.00%) - BytesSent: 2.83 MB (2969635) - OverallThroughput: 12.91 MB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.40K (30401) - RpcRetry: 0 (0) - SerializeBatchTime: 74.217ms - UncompressedRowBatchSize: 4.78 MB (5014160) CodeGen:(Total: 320.587ms, non-child: 320.587ms, % non-child: 100.00%) - CodegenTime: 889.822us - CompileTime: 62.322ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 82.942ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 162.613ms HDFS_SCAN_NODE (id=7):(Total: 149.824ms, non-child: 149.824ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 757.652us ; Min: 757.652us ; Max: 757.652us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.02 - BytesRead: 2.45 MB (2567984) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2567984) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2567984) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 5.520ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.51 MB (7876803) - PerReadThreadRawHdfsThroughput: 85.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 146.656ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.40K (30401) - RowsReturned: 30.40K (30401) - RowsReturnedRate: 202.91 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 203.795ms - MaterializeTupleTime(*): 48.909ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 58 (58) - TotalRawHdfsReadTime(*): 28.682ms - TotalReadThroughput: 98.34 KB/sec Instance b04615c310d227c4:3270037300000077 (host=vc1542.foo.com:22000):(Total: 22s878ms, non-child: 18s300ms, % non-child: 79.99%) Hdfs split stats (:<# splits>/): 6:1/3.71 MB MemoryUsage(500.000ms): 1.37 MB, 1.37 MB, 1.46 MB, 1.85 MB, 2.15 MB, 2.83 MB, 3.61 MB, 3.62 MB, 9.85 MB, 11.12 MB, 8.41 MB, 8.37 MB, 8.32 MB, 8.27 MB, 8.22 MB, 8.18 MB, 8.18 MB, 8.08 MB, 7.98 MB, 7.79 MB, 7.79 MB, 7.74 MB, 7.70 MB, 7.65 MB, 7.55 MB, 7.51 MB, 7.51 MB, 7.46 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.41 MB, 7.36 MB, 7.36 MB, 7.36 MB, 7.31 MB, 7.31 MB, 7.27 MB, 7.22 MB, 7.17 MB, 7.17 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.04 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.12 MB (11662052) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 419.76 MB (440149226) - RowsProduced: 30.39K (30392) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 17s824ms - TotalStorageWaitTime: 2.173ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 20s004ms - TotalThreadsSysTime: 24.996ms - TotalThreadsUserTime: 116.982ms - TotalThreadsVoluntaryContextSwitches: 689 (689) Fragment Instance Lifecycle Timings: - ExecTime: 18s817ms - ExecTreeExecTime: 447.636ms - OpenTime: 319.382ms - ExecTreeOpenTime: 96.155us - PrepareTime: 3s741ms - ExecTreePrepareTime: 139.011us KrpcDataStreamSender (dst_id=21):(Total: 3s310ms, non-child: 3s310ms, % non-child: 100.00%) - BytesSent: 2.84 MB (2973086) - OverallThroughput: 876.91 KB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 30.39K (30392) - RpcRetry: 0 (0) - SerializeBatchTime: 114.475ms - UncompressedRowBatchSize: 4.79 MB (5018829) CodeGen:(Total: 819.010ms, non-child: 819.010ms, % non-child: 100.00%) - CodegenTime: 1.027ms - CompileTime: 91.646ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 160.130ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 550.878ms HDFS_SCAN_NODE (id=7):(Total: 447.907ms, non-child: 447.907ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/3.71 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB, 2.45 MB - FooterProcessingTime: (Avg: 1.563ms ; Min: 1.563ms ; Max: 1.563ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.06 - BytesRead: 2.45 MB (2567890) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 MB (2567890) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 MB (2567890) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 95.694ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 7.46 MB (7826690) - PerReadThreadRawHdfsThroughput: 711.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 438.569ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 30.39K (30392) - RowsReturned: 30.39K (30392) - RowsReturnedRate: 67.85 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 867.696ms - MaterializeTupleTime(*): 322.230ms - ScannerThreadsSysTime: 12.998ms - ScannerThreadsUserTime: 17.997ms - ScannerThreadsVoluntaryContextSwitches: 141 (141) - TotalRawHdfsReadTime(*): 3.441ms - TotalReadThroughput: 122.33 KB/sec Instance b04615c310d227c4:3270037300000079 (host=vc1537.foo.com:22000):(Total: 13s946ms, non-child: 12s730ms, % non-child: 91.28%) Hdfs split stats (:<# splits>/): 3:1/961.80 KB MemoryUsage(500.000ms): 1.85 MB, 3.61 MB, 4.84 MB, 4.84 MB, 4.84 MB, 4.84 MB, 4.84 MB, 4.84 MB, 4.84 MB, 4.79 MB, 4.79 MB, 4.79 MB, 4.74 MB, 4.74 MB, 4.69 MB, 4.69 MB, 4.69 MB, 4.65 MB, 4.65 MB, 4.60 MB, 4.60 MB, 4.60 MB, 4.55 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB, 3.62 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.49 MB (5759974) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 358.22 MB (375625596) - RowsProduced: 7.48K (7483) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12s548ms - TotalStorageWaitTime: 978.900us - TotalThreadsInvoluntaryContextSwitches: 11 (11) - TotalThreadsTotalWallClockTime: 13s062ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 59.991ms - TotalThreadsVoluntaryContextSwitches: 398 (398) Fragment Instance Lifecycle Timings: - ExecTime: 12s803ms - ExecTreeExecTime: 54.042ms - OpenTime: 193.606ms - ExecTreeOpenTime: 90.205us - PrepareTime: 949.799ms - ExecTreePrepareTime: 279.836us KrpcDataStreamSender (dst_id=21):(Total: 751.241ms, non-child: 751.241ms, % non-child: 100.00%) - BytesSent: 711.43 KB (728504) - OverallThroughput: 947.00 KB/sec - PeakMemoryUsage: 3.61 MB (3784952) - RowsReturned: 7.48K (7483) - RpcRetry: 0 (0) - SerializeBatchTime: 19.572ms - UncompressedRowBatchSize: 1.18 MB (1232361) CodeGen:(Total: 409.572ms, non-child: 409.572ms, % non-child: 100.00%) - CodegenTime: 917.887us - CompileTime: 77.668ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 78.243ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 237.445ms HDFS_SCAN_NODE (id=7):(Total: 54.844ms, non-child: 54.844ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/961.80 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB, 696.55 KB - FooterProcessingTime: (Avg: 566.609us ; Min: 566.609us ; Max: 566.609us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 696.55 KB (713266) - BytesReadDataNodeCache: 0 - BytesReadLocal: 696.55 KB (713266) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 696.55 KB (713266) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 30.239us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.84 MB (1924612) - PerReadThreadRawHdfsThroughput: 365.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.118ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 7.48K (7483) - RowsReturned: 7.48K (7483) - RowsReturnedRate: 136.44 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 66.233ms - MaterializeTupleTime(*): 11.349ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 30 (30) - TotalRawHdfsReadTime(*): 1.859ms - TotalReadThroughput: 60.57 KB/sec Averaged Fragment F08:(Total: 6s435ms, non-child: 5s377ms, % non-child: 83.56%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:6s626ms max:6s626ms mean: 6s626ms stddev:0.000ns execution rates: min:332.47 KB/sec max:332.47 KB/sec mean:332.47 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 17.18 MB (18014282) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 1.10K (1096) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s370ms - TotalStorageWaitTime: 1.966ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 5s621ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 87.986ms - TotalThreadsVoluntaryContextSwitches: 196 (196) Fragment Instance Lifecycle Timings: - ExecTime: 5s397ms - ExecTreeExecTime: 25.179ms - OpenTime: 197.624ms - ExecTreeOpenTime: 100.481us - PrepareTime: 839.816ms - ExecTreePrepareTime: 191.175us KrpcDataStreamSender (dst_id=24):(Total: 309.048ms, non-child: 309.048ms, % non-child: 100.00%) - BytesSent: 8.59 KB (8801) - OverallThroughput: 27.81 KB/sec - PeakMemoryUsage: 16.44 MB (17243184) - RowsReturned: 1.10K (1096) - RpcRetry: 0 (0) - SerializeBatchTime: 165.933us - UncompressedRowBatchSize: 18.20 KB (18632) CodeGen:(Total: 723.217ms, non-child: 723.217ms, % non-child: 100.00%) - CodegenTime: 1.925ms - CompileTime: 39.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 29 (29) - NumInstructions: 525 (525) - OptimizationTime: 140.077ms - PeakMemoryUsage: 262.50 KB (268800) - PrepareTime: 539.089ms HDFS_SCAN_NODE (id=5):(Total: 25.697ms, non-child: 25.697ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6.297ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 744.27 KB (762130) - PerReadThreadRawHdfsThroughput: 240.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.929ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 1.10K (1096) - RowsReturnedRate: 42.65 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 26.242ms - MaterializeTupleTime(*): 3.215ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 1.885ms - TotalReadThroughput: 155.07 KB/sec Fragment F08: Instance b04615c310d227c4:32700373000000a4 (host=vc1515.foo.com:22000):(Total: 6s435ms, non-child: 5s377ms, % non-child: 83.56%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB MemoryUsage(500.000ms): 16.44 MB, 16.45 MB, 16.49 MB, 16.49 MB, 16.49 MB, 16.49 MB, 16.46 MB, 16.46 MB, 16.46 MB, 16.46 MB, 16.46 MB, 16.46 MB, 16.46 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 17.18 MB (18014282) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 336.34 MB (352675374) - RowsProduced: 1.10K (1096) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s370ms - TotalStorageWaitTime: 1.966ms - TotalThreadsInvoluntaryContextSwitches: 17 (17) - TotalThreadsTotalWallClockTime: 5s621ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 87.986ms - TotalThreadsVoluntaryContextSwitches: 196 (196) Fragment Instance Lifecycle Timings: - ExecTime: 5s397ms - ExecTreeExecTime: 25.179ms - OpenTime: 197.624ms - ExecTreeOpenTime: 100.481us - PrepareTime: 839.816ms - ExecTreePrepareTime: 191.175us KrpcDataStreamSender (dst_id=24):(Total: 309.048ms, non-child: 309.048ms, % non-child: 100.00%) - BytesSent: 8.59 KB (8801) - OverallThroughput: 27.81 KB/sec - PeakMemoryUsage: 16.44 MB (17243184) - RowsReturned: 1.10K (1096) - RpcRetry: 0 (0) - SerializeBatchTime: 165.933us - UncompressedRowBatchSize: 18.20 KB (18632) CodeGen:(Total: 723.217ms, non-child: 723.217ms, % non-child: 100.00%) - CodegenTime: 1.925ms - CompileTime: 39.242ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 29 (29) - NumInstructions: 525 (525) - OptimizationTime: 140.077ms - PeakMemoryUsage: 262.50 KB (268800) - PrepareTime: 539.089ms HDFS_SCAN_NODE (id=5):(Total: 25.697ms, non-child: 25.697ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 0, 465.22 KB, 465.22 KB, 465.22 KB, 465.22 KB - FooterProcessingTime: (Avg: 442.623us ; Min: 442.623us ; Max: 442.623us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 6.297ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 744.27 KB (762130) - PerReadThreadRawHdfsThroughput: 240.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 24.929ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 1.10K (1096) - RowsReturnedRate: 42.65 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 26.242ms - MaterializeTupleTime(*): 3.215ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsReadTime(*): 1.885ms - TotalReadThroughput: 155.07 KB/sec Averaged Fragment F09:(Total: 5s751ms, non-child: 5s285ms, % non-child: 91.90%) split sizes: min: 132.82 KB, max: 132.82 KB, avg: 132.82 KB, stddev: 0 completion times: min:5s850ms max:5s850ms mean: 5s850ms stddev:0.000ns execution rates: min:22.70 KB/sec max:22.70 KB/sec mean:22.70 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.35 MB (4560831) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 331.52 MB (347626415) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s252ms - TotalStorageWaitTime: 639.186us - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 5s518ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 31.994ms - TotalThreadsVoluntaryContextSwitches: 204 (204) Fragment Instance Lifecycle Timings: - ExecTime: 5s329ms - ExecTreeExecTime: 19.383ms - OpenTime: 145.537ms - ExecTreeOpenTime: 92.725us - PrepareTime: 275.652ms - ExecTreePrepareTime: 215.004us KrpcDataStreamSender (dst_id=25):(Total: 142.784ms, non-child: 142.784ms, % non-child: 100.00%) - BytesSent: 42.28 KB (43299) - OverallThroughput: 296.14 KB/sec - PeakMemoryUsage: 4.00 MB (4194024) - RowsReturned: 1.50K (1500) - RpcRetry: 0 (0) - SerializeBatchTime: 26.678ms - UncompressedRowBatchSize: 95.10 KB (97384) CodeGen:(Total: 303.132ms, non-child: 303.132ms, % non-child: 100.00%) - CodegenTime: 868.513us - CompileTime: 80.183ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 52.360ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 153.470ms HDFS_SCAN_NODE (id=6):(Total: 19.992ms, non-child: 19.992ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 114.20 KB (116942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 114.20 KB (116942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 114.20 KB (116942) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 12.389us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.98 KB (358381) - PerReadThreadRawHdfsThroughput: 148.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.149ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 75.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 42.850ms - MaterializeTupleTime(*): 279.350us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 753.501us - TotalReadThroughput: 76.13 KB/sec Fragment F09: Instance b04615c310d227c4:32700373000000a5 (host=vc1513.foo.com:22000):(Total: 5s751ms, non-child: 5s285ms, % non-child: 91.90%) Hdfs split stats (:<# splits>/): 2:1/132.82 KB MemoryUsage(500.000ms): 4.01 MB, 4.10 MB, 4.10 MB, 4.01 MB, 4.01 MB, 4.01 MB, 4.01 MB, 4.01 MB, 4.01 MB, 4.01 MB, 4.01 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.35 MB (4560831) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 331.52 MB (347626415) - RowsProduced: 1.50K (1500) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s252ms - TotalStorageWaitTime: 639.186us - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 5s518ms - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 31.994ms - TotalThreadsVoluntaryContextSwitches: 204 (204) Fragment Instance Lifecycle Timings: - ExecTime: 5s329ms - ExecTreeExecTime: 19.383ms - OpenTime: 145.537ms - ExecTreeOpenTime: 92.725us - PrepareTime: 275.652ms - ExecTreePrepareTime: 215.004us KrpcDataStreamSender (dst_id=25):(Total: 142.784ms, non-child: 142.784ms, % non-child: 100.00%) - BytesSent: 42.28 KB (43299) - OverallThroughput: 296.14 KB/sec - PeakMemoryUsage: 4.00 MB (4194024) - RowsReturned: 1.50K (1500) - RpcRetry: 0 (0) - SerializeBatchTime: 26.678ms - UncompressedRowBatchSize: 95.10 KB (97384) CodeGen:(Total: 303.132ms, non-child: 303.132ms, % non-child: 100.00%) - CodegenTime: 868.513us - CompileTime: 80.183ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.93 MB (2024520) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 52.360ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 153.470ms HDFS_SCAN_NODE (id=6):(Total: 19.992ms, non-child: 19.992ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/132.82 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0, 114.20 KB, 114.20 KB - FooterProcessingTime: (Avg: 770.170us ; Min: 770.170us ; Max: 770.170us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 114.20 KB (116942) - BytesReadDataNodeCache: 0 - BytesReadLocal: 114.20 KB (116942) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 114.20 KB (116942) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 12.389us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.98 KB (358381) - PerReadThreadRawHdfsThroughput: 148.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.149ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.50K (1500) - RowsReturned: 1.50K (1500) - RowsReturnedRate: 75.03 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 42.850ms - MaterializeTupleTime(*): 279.350us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsReadTime(*): 753.501us - TotalReadThroughput: 76.13 KB/sec